-- Logs begin at Thu 2022-07-28 04:39:13 UTC, end at Thu 2022-07-28 05:52:24 UTC. -- Jul 28 05:22:10.537886 dv-cinder-799871-48-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 28 05:22:10.548405 dv-cinder-799871-48-iscsi devstack@n-api.service[103522]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 28 05:22:10.550537 dv-cinder-799871-48-iscsi devstack@n-api.service[103522]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 28 05:22:10 2022] *** Jul 28 05:22:10.550537 dv-cinder-799871-48-iscsi devstack@n-api.service[103522]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 28 05:22:10.550537 dv-cinder-799871-48-iscsi devstack@n-api.service[103522]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 28 05:22:10.550537 dv-cinder-799871-48-iscsi devstack@n-api.service[103522]: nodename: dv-cinder-799871-48-iscsi Jul 28 05:22:10.550537 dv-cinder-799871-48-iscsi devstack@n-api.service[103522]: machine: x86_64 Jul 28 05:22:10.550537 dv-cinder-799871-48-iscsi devstack@n-api.service[103522]: clock source: unix Jul 28 05:22:10.550537 dv-cinder-799871-48-iscsi devstack@n-api.service[103522]: pcre jit disabled Jul 28 05:22:10.550537 dv-cinder-799871-48-iscsi devstack@n-api.service[103522]: detected number of CPU cores: 4 Jul 28 05:22:10.550537 dv-cinder-799871-48-iscsi devstack@n-api.service[103522]: current working directory: / Jul 28 05:22:10.550537 dv-cinder-799871-48-iscsi devstack@n-api.service[103522]: detected binary path: /usr/bin/uwsgi-core Jul 28 05:22:10.551228 dv-cinder-799871-48-iscsi devstack@n-api.service[103522]: your processes number limit is 47680 Jul 28 05:22:10.551228 dv-cinder-799871-48-iscsi devstack@n-api.service[103522]: your memory page size is 4096 bytes Jul 28 05:22:10.551228 dv-cinder-799871-48-iscsi devstack@n-api.service[103522]: detected max file descriptor number: 2048 Jul 28 05:22:10.551228 dv-cinder-799871-48-iscsi devstack@n-api.service[103522]: lock engine: pthread robust mutexes Jul 28 05:22:10.551228 dv-cinder-799871-48-iscsi devstack@n-api.service[103522]: thunder lock: enabled Jul 28 05:22:10.551228 dv-cinder-799871-48-iscsi devstack@n-api.service[103522]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 28 05:22:10.551228 dv-cinder-799871-48-iscsi devstack@n-api.service[103522]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 28 05:22:10.590901 dv-cinder-799871-48-iscsi devstack@n-api.service[103522]: Python main interpreter initialized at 0x55d28755f9c0 Jul 28 05:22:10.590901 dv-cinder-799871-48-iscsi devstack@n-api.service[103522]: python threads support enabled Jul 28 05:22:10.590901 dv-cinder-799871-48-iscsi devstack@n-api.service[103522]: your server socket listen backlog is limited to 100 connections Jul 28 05:22:10.590901 dv-cinder-799871-48-iscsi devstack@n-api.service[103522]: your mercy for graceful operations on workers is 90 seconds Jul 28 05:22:10.591259 dv-cinder-799871-48-iscsi devstack@n-api.service[103522]: mapped 403077 bytes (393 KB) for 2 cores Jul 28 05:22:10.591334 dv-cinder-799871-48-iscsi devstack@n-api.service[103522]: *** Operational MODE: preforking *** Jul 28 05:22:10.591570 dv-cinder-799871-48-iscsi devstack@n-api.service[103522]: *** uWSGI is running in multiple interpreter mode *** Jul 28 05:22:10.591570 dv-cinder-799871-48-iscsi devstack@n-api.service[103522]: spawned uWSGI master process (pid: 103522) Jul 28 05:22:10.592296 dv-cinder-799871-48-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 28 05:22:10.593930 dv-cinder-799871-48-iscsi devstack@n-api.service[103522]: spawned uWSGI worker 1 (pid: 103523, cores: 1) Jul 28 05:22:10.593930 dv-cinder-799871-48-iscsi devstack@n-api.service[103522]: spawned uWSGI worker 2 (pid: 103524, cores: 1) Jul 28 05:22:10.593930 dv-cinder-799871-48-iscsi devstack@n-api.service[103522]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 28 05:22:11.258560 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 28 05:22:11.269495 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 28 05:22:12.338964 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 05:22:12.338964 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: from cryptography.utils import int_from_bytes Jul 28 05:22:12.339528 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 05:22:12.339528 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: from cryptography.utils import int_from_bytes Jul 28 05:22:12.342931 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 05:22:12.342931 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: from cryptography.utils import int_from_bytes Jul 28 05:22:12.343364 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 05:22:12.343364 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: from cryptography.utils import int_from_bytes Jul 28 05:22:14.807446 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 05:22:14.808017 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 05:22:14.808202 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 05:22:14.808556 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 05:22:14.808803 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 05:22:14.809180 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.809508 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 05:22:14.809944 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.810059 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 05:22:14.810156 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.810156 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.810971 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 05:22:14.811067 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.811267 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.811365 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 05:22:14.811580 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.811694 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 05:22:14.811895 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.812010 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.812214 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.812314 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.812469 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.812590 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.812775 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.812910 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.813092 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-799871-48-iscsi {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.813240 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.813412 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.813586 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.813737 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.813906 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.814044 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.814224 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.814356 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.814550 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.814649 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.814808 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.814955 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.815121 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.815255 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.815443 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-799871-48-iscsi {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.815743 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.815848 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.816054 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.816169 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.816365 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.816493 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.816685 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.816807 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.816991 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.817114 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.817311 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.817490 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.817632 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.817766 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.817985 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.818137 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.818297 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.818435 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.818591 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.818749 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.818890 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.819061 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.819265 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-799871-48-iscsi {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.819405 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.819575 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.819711 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.819881 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.820025 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.820186 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.820322 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.820587 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.820721 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.820892 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.821026 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.821194 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.821330 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.821527 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.821672 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-799871-48-iscsi {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.821855 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.822003 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.822140 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.822265 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.822462 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.822620 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.822777 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.822915 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.823089 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.823219 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.823406 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.823545 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.823684 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.823822 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.823989 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.824125 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.824288 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.824425 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.824630 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.824765 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.824890 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.825022 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.825148 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.825282 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.825417 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.825625 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.825763 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.826007 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.826148 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.826316 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.826457 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.826626 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.826764 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.826894 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.827029 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.827170 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.827305 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.827442 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.827569 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.827699 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.827831 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.827990 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.828121 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.828291 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.828427 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.828590 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.828726 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.828889 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.829025 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.829186 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.829318 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.829442 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.829617 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.829748 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.829873 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.830062 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.830193 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.830369 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.830509 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.830674 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.830801 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.830975 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.831110 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.831272 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.831408 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.831572 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.831707 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.831877 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.832013 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.832186 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.832318 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.832473 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.832610 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.832787 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.832914 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.833098 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.833239 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.833397 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.833560 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.833732 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.833859 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.834042 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.834182 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.834341 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.834471 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.834641 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.834782 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.834938 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.835067 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.835248 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.835378 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.835570 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.835713 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.835868 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.835998 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.836121 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.836245 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.836375 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.836515 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.836672 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.836802 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.836981 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.837110 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.837277 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.837415 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.837594 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.837736 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.837893 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.838031 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.838186 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.838328 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.838482 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.838618 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.838779 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.838908 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.839076 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.839206 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.839372 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.839501 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.839669 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.839798 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.839968 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.840099 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.840267 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.840413 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.840563 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.840697 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.840844 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.840969 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.841154 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.841283 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.842005 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.842151 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.842311 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.842448 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.842610 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.842751 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.842909 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.843049 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.843208 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.843347 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.843520 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.843649 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.843813 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.843949 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.844108 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.844246 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.844420 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.844549 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.844721 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.844861 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.845021 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.845150 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.845330 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.845491 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.845655 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.845787 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.845955 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.846087 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.846264 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.846401 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.846558 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.846700 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.846856 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.846986 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.847165 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.847302 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.847463 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.847601 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.847762 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.847898 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.848065 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.848198 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.848344 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.848487 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.848626 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.848758 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.848925 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.849055 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.849221 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.849360 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.849532 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.849660 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.849820 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.849963 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.850129 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.850269 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.850430 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.850568 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.850728 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.850856 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.851059 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.851187 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.851313 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.851444 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.851607 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.851736 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.851912 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.852042 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.852211 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.852341 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.852527 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.852665 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.852845 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.852975 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.853151 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.853287 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.853455 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.853620 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.853799 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.853926 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.854104 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.854234 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:22:14.854411 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.854554 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.854729 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.854858 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.855033 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.855173 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.855339 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.855478 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.855644 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.855780 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.855955 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.856085 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.856265 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.856395 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.856586 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.856725 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.856897 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.857032 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.857927 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.858063 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.858252 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.858403 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.858567 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.858700 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.858883 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.859026 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.859209 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.859347 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.859525 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.859656 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.859832 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.859964 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.860168 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.860297 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.860485 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.860620 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.860800 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.860935 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.861111 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.861254 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.861423 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.861581 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.861751 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.861883 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.862057 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.862207 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.862361 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.862491 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.862677 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.862808 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.862997 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.863127 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.863302 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.863441 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.863618 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.863755 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.863921 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.864058 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.864225 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.864365 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.864533 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.864663 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.864836 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.864959 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.865140 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.865279 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.865510 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.865642 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.865798 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.865926 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.866105 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.866246 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.866411 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.866540 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.866718 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.866845 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.867019 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.867149 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.867321 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.867450 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.867622 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.867760 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.867920 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.868051 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.868217 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.868346 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.868514 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.868652 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.868818 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.868948 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.869115 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.869252 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.869428 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.869595 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.869768 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.869898 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.870064 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.870193 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.870367 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.870496 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.870674 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.870804 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.870977 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.871106 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.871280 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.871419 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.871582 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.871710 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.871878 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.872006 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.872181 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.872320 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.872484 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.872614 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.872898 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.873039 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.873227 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.873375 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.873564 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.873698 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.873871 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.874008 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.874190 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.874401 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.874531 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.874664 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.874790 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.874915 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.875078 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.875210 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.875389 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.875520 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.875698 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.875837 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.876006 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.876138 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.876317 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.876445 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.876633 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.876768 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.876939 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.877074 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.877242 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.877370 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.877578 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.877730 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.877893 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.878023 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.878194 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.878323 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.878506 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.878644 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.878820 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.878949 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.879130 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.879260 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.879428 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.879569 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.879734 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.879865 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.880032 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.880169 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.880331 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.880473 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.880653 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.880794 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.880961 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.881091 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.881259 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.881398 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.881580 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.881713 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.881881 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.882011 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.882178 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.882310 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.882475 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.882604 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.882775 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.882903 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.883078 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.883209 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.883373 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.883501 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.883674 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.883811 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.883954 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.884085 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.884258 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.884386 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.884562 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.884705 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.884867 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.884997 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.885190 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.885319 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.885519 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.885665 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.885826 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.885965 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.886128 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.886257 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.886429 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.886568 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.886733 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.886861 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.887039 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.887170 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.887344 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.887484 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.887648 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.887787 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.887961 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.888100 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.888265 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.888476 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.888608 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.888799 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.888987 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.889126 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.889312 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.889443 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.889637 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.889784 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.889943 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.890075 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.890242 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.890373 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.890552 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.890681 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.890884 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.891021 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.891209 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.891340 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.891518 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.891656 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.891833 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.891969 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.892136 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.892267 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.892444 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.892566 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.892746 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.892876 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.893046 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.893174 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.893349 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.893503 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.893683 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.893825 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.893992 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.894129 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.894294 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.894424 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.894604 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.894746 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.894909 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.895045 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.895223 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.895353 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.895523 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.895661 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.895832 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.895968 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.896127 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.896261 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.896435 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.896575 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.896742 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.896871 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.897058 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.897188 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.897361 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.897545 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.897674 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.897809 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.897991 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.898130 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.898294 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.898418 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.898596 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.898730 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.898900 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.899028 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.899200 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.899332 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.899498 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.899629 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.899800 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.899930 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.900108 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.900239 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.900413 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.900550 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.900717 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.900855 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.901014 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.901145 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.901322 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.901453 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.901648 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.901788 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.901944 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.902074 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.902240 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.902370 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.902543 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.902856 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.903309 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.903433 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.903542 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.903685 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.903803 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.904543 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.904669 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.904862 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.904979 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.905188 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.905313 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.905525 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.905646 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.905873 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.905989 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.906173 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.906302 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.906471 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.906594 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.906807 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.906924 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.907113 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.907241 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.907413 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.907504 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.907723 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.907811 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.908042 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.908198 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.908349 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.908442 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.908662 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.908791 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.908970 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.909101 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.909276 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.909405 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.909614 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.909811 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.909957 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.910124 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.910261 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.910471 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.910601 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.910786 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.910924 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.911094 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.911222 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.911397 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.911525 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.911714 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.911857 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.912021 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.912158 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.912328 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.912457 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.912632 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.912763 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.912933 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.913062 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.913238 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.913368 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.913573 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.913706 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.913884 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.914142 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.914283 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.914469 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.914609 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.914779 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.914907 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.915088 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.915216 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.915400 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.915538 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.915706 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.915841 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.916016 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.916144 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.916325 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.916456 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.916629 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.916758 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.916966 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.917109 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.917242 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.917368 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.917546 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.917844 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.917974 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.918149 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.918278 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.918449 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.918580 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.918747 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.918878 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.919047 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.919184 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.919353 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.919485 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.920182 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.920484 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.920613 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.920781 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.920922 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.921081 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.921211 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.921392 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.921800 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.921972 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.922102 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.922278 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.922410 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.922579 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.922710 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.922896 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.923035 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.923199 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.923330 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.923496 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.923635 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.923794 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.923932 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.924095 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.924225 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.924397 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.924525 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.924704 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.924843 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.925006 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.925144 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.925310 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.925447 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.925638 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.925782 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.925942 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.926072 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.926253 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.926380 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.926555 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.926697 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.926856 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.926984 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.927154 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.927284 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.927450 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.927581 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.927753 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.927890 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.928054 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.928189 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.928393 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.928529 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.928664 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.928790 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.928916 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.929041 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.929215 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.929347 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.929538 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.929686 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.929836 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.929967 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.930138 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.930270 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.930433 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.930572 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.930741 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.930881 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.931042 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.931173 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.931337 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.931467 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.931632 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.931772 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.931934 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.932075 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.932235 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.932366 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.932530 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.932671 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.932832 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.932969 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.933126 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.933263 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.933432 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.933590 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.933751 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.933881 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.934053 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.934185 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.934349 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.934489 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.934650 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.934780 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.934952 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.935082 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.935326 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.935458 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.935635 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.935765 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.935947 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.936105 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.936245 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.936405 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.936543 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.936705 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.936842 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.937009 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.937148 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.937306 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.937436 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.937611 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.937737 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.937919 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.938050 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.938234 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.938365 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.938542 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.938673 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.938838 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.938968 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.939141 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.939270 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.939437 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.939566 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.939734 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.939866 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.940031 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.940160 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.940331 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.940463 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.940626 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.940765 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.940924 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.941062 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.941220 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.941359 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.941537 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.941669 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.941835 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.941965 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.942151 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.942293 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.942454 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.942585 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.942751 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.942880 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.943047 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.943186 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.943343 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.943472 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.943648 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.943805 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.943957 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.944097 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.944258 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.944389 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.944562 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.944693 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.944865 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.945005 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.945169 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.945305 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.945497 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.945642 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.945814 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.945946 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.946126 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.946263 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.946428 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.946558 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.946730 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.946869 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.947030 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.947160 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.947335 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.947470 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.947635 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.947767 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.947933 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.948063 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.948248 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.948383 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.948552 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.948682 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.948855 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.948990 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.949169 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.949312 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.949493 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.949624 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.949812 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.949952 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.950111 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.950254 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.950415 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.950545 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.950719 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.950872 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.951054 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.951190 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.951439 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.951567 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.951701 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.951828 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.951954 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.952089 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.952248 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.952379 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.952558 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.952688 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.952878 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.953019 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.953198 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.953329 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.953543 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.953676 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.953849 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.953987 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.954155 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.954292 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.954454 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.954591 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.954772 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.954908 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.955074 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.955204 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.955372 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.955502 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.955675 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.955806 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.955971 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.956113 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.956273 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.956485 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.956628 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.956745 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.956903 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.957031 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.957215 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.957357 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.957532 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.957660 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.957847 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.957977 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.958148 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.958290 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.958453 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.958582 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.958759 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.958888 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.959063 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.959200 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.959359 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.959488 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.959667 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.959794 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.959975 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.960106 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.960280 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.960411 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.960631 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.960767 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.960930 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.961069 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.961225 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.961354 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.961547 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.961679 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.961866 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.962009 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.962164 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.962293 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.962461 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.962592 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.962760 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.962890 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.963075 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.963212 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.963372 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.963512 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.963686 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.963815 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.964076 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.964204 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.964386 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.964525 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.964682 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.964809 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.964984 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.965111 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.965294 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.965433 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.965647 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.965777 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.965954 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.966083 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.966258 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.966905 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.967163 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.967329 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.967515 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.967647 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.967787 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.967914 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.968045 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.968171 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.968295 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.968418 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.968591 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.968731 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.968894 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.969030 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.969202 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.969354 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.969513 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.969686 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.969831 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.970000 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.970130 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.970329 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.970460 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.970652 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.970790 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.970975 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.971105 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.971281 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.971420 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.971597 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.971739 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.971910 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.972041 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.972236 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.972367 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.972560 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.972699 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.972872 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.973004 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.973175 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.973303 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.973519 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.973667 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.973795 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.973928 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.974101 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.974233 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.974399 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.974531 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.974709 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.974839 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.975011 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.975142 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.975314 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.975446 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.975612 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.975741 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.975916 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.976092 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.976221 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.976359 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.976489 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.976666 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.976796 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.976973 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.977115 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.977285 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.977424 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.977614 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.977757 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.977921 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.978053 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.978244 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.978381 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.978550 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.978679 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.978861 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.978992 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.979163 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.979284 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.979461 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.979609 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.979762 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.979890 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.980069 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.980200 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.980383 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.980522 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.980684 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.980813 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.981006 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.981136 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.981308 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.981446 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.981653 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.981780 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.981968 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.982642 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.982799 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.982983 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.983144 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.983303 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.983431 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.983563 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.983698 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.983824 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.983993 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.984116 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.984295 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.984425 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.984612 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.984740 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.984910 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.985038 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.985208 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.985347 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.985532 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.985665 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.985832 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.985973 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.986128 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.986258 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.986424 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.986561 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.986739 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.986869 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.987038 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.987176 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.987354 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.987492 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.987656 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.987785 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.987955 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.988092 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.988251 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.988380 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.988546 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.988684 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.988870 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.989007 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.989169 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.989303 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.989506 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.989638 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.989803 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.989934 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.990110 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.990239 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.990411 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.990546 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.990713 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.990843 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.991027 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.991154 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.991328 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.991456 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.991635 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.991763 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.991942 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.992070 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.992241 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.992367 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.992545 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.992683 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.992847 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.992976 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.993151 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.993285 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.993455 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.993613 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.993785 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.993916 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.994092 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.994222 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.994402 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.994532 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.994739 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.994922 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.995052 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.995242 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.995378 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.995550 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.995681 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.995856 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.995987 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.996161 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.996290 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.996455 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.996579 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.996761 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.996892 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.997066 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.997198 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.997370 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.997546 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.997775 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.997917 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.998086 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.998276 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.998415 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.998543 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.998711 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.998844 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.999030 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.999231 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.999368 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.999558 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.999689 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:14.999872 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.000004 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.000190 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.000329 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.000503 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.000651 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.000817 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.000947 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.001130 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.001270 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.001444 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.001609 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.001772 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.001901 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.002079 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.002207 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.002386 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.002516 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.002692 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.002822 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.002998 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.003130 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.003334 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.003465 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.003598 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.003725 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.003890 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.004030 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.004197 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.004331 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.004503 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.004633 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.004814 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.004952 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.005131 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.005262 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.005458 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.005625 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.005797 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.005940 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.006105 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.006235 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.006413 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.006544 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.006721 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.006852 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.007031 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.007231 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.007361 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.007540 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.007684 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.007865 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.007995 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.008184 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.008368 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.008512 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.008655 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.008791 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.008918 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.009094 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.009227 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.009414 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.009580 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.009737 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.009874 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.010035 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.010165 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.010366 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.010496 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.010620 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.010754 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.010916 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.011055 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.011231 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.011498 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.011629 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.011815 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.011946 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.012125 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.012267 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.012427 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.012558 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.012767 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.012955 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.013087 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.013318 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.013545 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.013723 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.013854 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.013980 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.014220 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.014352 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.014529 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.014659 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.014843 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.014974 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.015155 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.015296 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.015459 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.015597 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.015756 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.015886 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.016068 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.016200 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.016369 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.016497 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.016663 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.016792 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.016962 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.017131 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.017260 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.017529 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.017664 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.017874 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.018005 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.018179 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.018309 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.018474 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.018604 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.018792 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.018931 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.019091 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.019231 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.019389 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.019521 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.019688 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.019819 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.019991 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.020130 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.020287 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.020429 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.020584 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.020714 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.020882 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.021012 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.021176 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.021317 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.021515 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.021648 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.021799 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.021928 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.022100 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.022250 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.022399 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.022529 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.022701 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.022838 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.022999 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.023144 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.023301 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.023433 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.023611 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.023740 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.023917 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.024057 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.024222 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.024353 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.024525 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.024654 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.024825 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.024962 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.025128 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.025256 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.025431 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.025583 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.025757 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.025889 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.026058 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.026194 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.026360 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.026490 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.026669 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.026801 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.026974 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.027199 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.027331 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.027525 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.027665 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.027837 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.027967 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.028164 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.028302 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.028489 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.028621 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.028789 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.029512 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.029685 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.029855 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.029997 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.030181 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.030312 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.030494 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.030626 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.030820 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.030958 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.031125 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.031255 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.031430 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.031561 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.031735 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.031867 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.032037 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.032167 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.032340 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.032591 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.032731 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.032925 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.033055 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.033225 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.033354 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.033550 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.033696 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.033855 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.033985 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.034157 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.034287 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.034458 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.034590 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.034767 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.034899 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.035096 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.035225 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.035406 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.035542 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.035715 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.035846 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.036023 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.036153 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.036333 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.036462 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.036634 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.036762 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.036938 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.037068 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.037241 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.037372 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.037564 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.037689 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.037874 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.038023 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.038184 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.038314 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.038489 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.038626 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.038789 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.038932 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.039098 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.039233 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.039406 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.039544 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.039720 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.039933 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.040065 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.040198 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.040363 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.040493 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.040678 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.040808 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.040992 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.041122 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.041293 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.041422 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.041632 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.041771 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.041937 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.042067 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.042246 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.042376 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.042556 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.042687 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.042869 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.042999 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.043188 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.043327 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.043487 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.043619 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.043787 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.043953 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.044082 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.044216 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.044375 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.044528 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.045362 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.045560 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.045740 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.045896 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.046032 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.046159 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.046285 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.046411 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.046822 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.046965 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.047125 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.047263 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.047423 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.047553 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.047721 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.047853 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.048020 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.048151 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.048325 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.048457 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.048622 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.048754 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.048919 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.049058 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.049216 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.049346 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.049532 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.049665 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.049831 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.049961 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.050128 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.050271 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.050431 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.050563 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.050727 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.050860 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.051021 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.051161 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.051318 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.051456 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.051616 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.051746 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.051911 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.052054 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.052235 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.052365 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.052562 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.052693 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.052866 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.053009 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.053177 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.053315 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.053504 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.053639 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.053806 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.053938 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.054108 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.054237 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.054408 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.054544 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.054710 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.054842 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.055011 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.055141 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.055318 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.055447 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.055642 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.055782 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.055947 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.056078 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.056249 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.056388 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.056551 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.056690 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.056855 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.056986 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.057158 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.057302 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.057522 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.057662 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.057798 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.057926 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.058104 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.058244 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.058403 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.058534 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.058720 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.058851 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.059028 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.059169 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.059341 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.059473 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.059649 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.059772 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.059951 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.060076 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.060314 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.060447 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.060617 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.060747 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.060919 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.061060 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.061224 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.061366 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.061531 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.061665 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.061840 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.061979 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.062149 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.062279 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.062452 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.062591 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.062756 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.062893 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.063065 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.063202 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.063373 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.063514 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.063690 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.063817 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.064001 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.064129 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.064303 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.064439 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.064621 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.064758 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.064927 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.065055 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.065254 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.065393 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.065588 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.065717 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.065899 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.066028 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.066210 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.066342 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.066521 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.066659 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.066823 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.066951 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.067121 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.067257 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.067384 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 05:22:15.067516 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.067728 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.068042 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.068359 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.068687 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.069014 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.069327 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.069680 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.070011 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.070357 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.070675 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.071020 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.071348 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.071665 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.071976 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.072281 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:22:15.072525 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 05:22:15.222468 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: INFO dbcounter [None req-167b694d-529b-496a-9159-a46a538996fa None None] Registered counter for database nova_api Jul 28 05:22:15.227453 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: INFO dbcounter [None req-b4971713-bebc-48b6-93b7-8588822a8767 None None] Registered counter for database nova_api Jul 28 05:22:15.245902 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG oslo_db.sqlalchemy.engines [None req-167b694d-529b-496a-9159-a46a538996fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103523) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 05:22:15.247349 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG oslo_db.sqlalchemy.engines [None req-b4971713-bebc-48b6-93b7-8588822a8767 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103524) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 05:22:15.252597 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG dbcounter [-] [103523] Writer thread running {{(pid=103523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 05:22:15.254228 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG dbcounter [-] [103524] Writer thread running {{(pid=103524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 05:22:15.309079 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.context [None req-167b694d-529b-496a-9159-a46a538996fa None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2db56fa7-dc06-44d8-9adb-2fc5d306a2ac(cell1) {{(pid=103523) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 05:22:15.309307 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.context [None req-b4971713-bebc-48b6-93b7-8588822a8767 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2db56fa7-dc06-44d8-9adb-2fc5d306a2ac(cell1) {{(pid=103524) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 05:22:15.313066 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-167b694d-529b-496a-9159-a46a538996fa None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:22:15.313572 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG oslo_concurrency.lockutils [None req-b4971713-bebc-48b6-93b7-8588822a8767 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:22:15.314669 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-167b694d-529b-496a-9159-a46a538996fa None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:22:15.315124 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG oslo_concurrency.lockutils [None req-b4971713-bebc-48b6-93b7-8588822a8767 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:22:15.315464 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-167b694d-529b-496a-9159-a46a538996fa None None] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:22:15.315891 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG oslo_concurrency.lockutils [None req-b4971713-bebc-48b6-93b7-8588822a8767 None None] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:22:15.317451 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-167b694d-529b-496a-9159-a46a538996fa None None] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:22:15.317868 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG oslo_concurrency.lockutils [None req-b4971713-bebc-48b6-93b7-8588822a8767 None None] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:22:15.319469 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: INFO dbcounter [None req-167b694d-529b-496a-9159-a46a538996fa None None] Registered counter for database nova_cell0 Jul 28 05:22:15.319830 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: INFO dbcounter [None req-b4971713-bebc-48b6-93b7-8588822a8767 None None] Registered counter for database nova_cell0 Jul 28 05:22:15.324893 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: INFO dbcounter [None req-167b694d-529b-496a-9159-a46a538996fa None None] Registered counter for database nova_cell1 Jul 28 05:22:15.325262 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: INFO dbcounter [None req-b4971713-bebc-48b6-93b7-8588822a8767 None None] Registered counter for database nova_cell1 Jul 28 05:22:15.332793 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG oslo_db.sqlalchemy.engines [None req-167b694d-529b-496a-9159-a46a538996fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103523) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 05:22:15.335318 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG oslo_db.sqlalchemy.engines [None req-167b694d-529b-496a-9159-a46a538996fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103523) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 05:22:15.336197 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG oslo_db.sqlalchemy.engines [None req-b4971713-bebc-48b6-93b7-8588822a8767 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103524) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 05:22:15.338710 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG dbcounter [-] [103523] Writer thread running {{(pid=103523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 05:22:15.338857 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG oslo_db.sqlalchemy.engines [None req-b4971713-bebc-48b6-93b7-8588822a8767 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103524) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 05:22:15.343221 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG dbcounter [-] [103524] Writer thread running {{(pid=103524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 05:22:15.479748 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG dbcounter [-] [103523] Writer thread running {{(pid=103523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 05:22:15.482988 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG dbcounter [-] [103524] Writer thread running {{(pid=103524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 05:22:15.488424 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: INFO dbcounter [None req-167b694d-529b-496a-9159-a46a538996fa None None] Registered counter for database nova_cell0 Jul 28 05:22:15.492175 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: INFO dbcounter [None req-b4971713-bebc-48b6-93b7-8588822a8767 None None] Registered counter for database nova_cell0 Jul 28 05:22:15.495253 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG oslo_db.sqlalchemy.engines [None req-167b694d-529b-496a-9159-a46a538996fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103523) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 05:22:15.498928 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG oslo_db.sqlalchemy.engines [None req-b4971713-bebc-48b6-93b7-8588822a8767 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103524) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 05:22:15.500012 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG dbcounter [-] [103523] Writer thread running {{(pid=103523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 05:22:15.503578 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG dbcounter [-] [103524] Writer thread running {{(pid=103524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 05:22:15.928061 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: WARNING keystonemiddleware.auth_token [None req-167b694d-529b-496a-9159-a46a538996fa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 05:22:15.935926 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: WARNING keystonemiddleware.auth_token [None req-167b694d-529b-496a-9159-a46a538996fa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 05:22:15.944770 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: WARNING keystonemiddleware.auth_token [None req-b4971713-bebc-48b6-93b7-8588822a8767 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 05:22:15.952706 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: WARNING keystonemiddleware.auth_token [None req-b4971713-bebc-48b6-93b7-8588822a8767 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 05:22:16.276866 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: WARNING keystonemiddleware.auth_token [None req-167b694d-529b-496a-9159-a46a538996fa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 05:22:16.282898 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: WARNING keystonemiddleware.auth_token [None req-167b694d-529b-496a-9159-a46a538996fa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 05:22:16.288175 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d28755f9c0 pid: 103523 (default app) Jul 28 05:22:16.290256 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-167b694d-529b-496a-9159-a46a538996fa None None] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:22:16.291439 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-167b694d-529b-496a-9159-a46a538996fa None None] 10.222.0.33 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001758 Jul 28 05:22:16.291852 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 1/1] 10.222.0.33 () {50 vars in 788 bytes} [Thu Jul 28 05:22:16 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:22:16.294098 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: WARNING keystonemiddleware.auth_token [None req-b4971713-bebc-48b6-93b7-8588822a8767 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 05:22:16.300982 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: WARNING keystonemiddleware.auth_token [None req-b4971713-bebc-48b6-93b7-8588822a8767 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 05:22:16.306339 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d28755f9c0 pid: 103524 (default app) Jul 28 05:23:34.966104 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-167b694d-529b-496a-9159-a46a538996fa None None] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:23:34.967110 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-167b694d-529b-496a-9159-a46a538996fa None None] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Jul 28 05:23:34.967501 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 2/2] 10.222.0.33 () {54 vars in 930 bytes} [Thu Jul 28 05:23:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:23:34.984491 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG dbcounter [-] [103524] Writing DB stats nova_api:SELECT=3 {{(pid=103524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:34.986139 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG dbcounter [-] [103524] Writing DB stats nova_cell1:SELECT=3 {{(pid=103524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:34.987126 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG dbcounter [-] [103524] Writing DB stats nova_cell0:SELECT=3 {{(pid=103524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:34.988118 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG dbcounter [-] [103524] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:35.858636 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-06c11abb-c0ff-460c-ad8d-e74dcc0642b2 admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:23:35.890537 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-06c11abb-c0ff-460c-ad8d-e74dcc0642b2 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.916215 Jul 28 05:23:35.891326 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 1/3] 10.222.0.33 () {60 vars in 1291 bytes} [Thu Jul 28 05:23:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:23:38.110677 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-167b694d-529b-496a-9159-a46a538996fa None None] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:23:38.111550 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-167b694d-529b-496a-9159-a46a538996fa None None] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001399 Jul 28 05:23:38.112237 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 3/4] 10.222.0.33 () {54 vars in 930 bytes} [Thu Jul 28 05:23:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:23:38.586687 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-b75b28e2-1b8f-4a6b-87c4-f02b67533428 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "rxtx_factor": 1.0, "name": "cirros256", "swap": 0, "disk": 1, "vcpus": 1}} {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:23:38.609192 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 05:23:38.609192 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: warnings.warn(msg) Jul 28 05:23:38.709345 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-b75b28e2-1b8f-4a6b-87c4-f02b67533428 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.591116 Jul 28 05:23:38.710069 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 2/5] 10.222.0.33 () {64 vars in 1282 bytes} [Thu Jul 28 05:23:38 2022] POST /compute/v2.1/flavors => generated 407 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 05:23:38.723841 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG dbcounter [-] [103523] Writing DB stats nova_api:SELECT=3 {{(pid=103523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:38.725144 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG dbcounter [-] [103523] Writing DB stats nova_cell1:SELECT=3 {{(pid=103523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:38.726316 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG dbcounter [-] [103523] Writing DB stats nova_cell0:SELECT=3 {{(pid=103523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:38.727476 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG dbcounter [-] [103523] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:38.935787 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-3dbe048d-f67f-4977-80c9-cce7369e86de admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:23:38.940145 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 05:23:38.940145 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: warnings.warn(msg) Jul 28 05:23:39.066341 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-3dbe048d-f67f-4977-80c9-cce7369e86de admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.348010 Jul 28 05:23:39.075666 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 4/6] 10.222.0.33 () {64 vars in 1335 bytes} [Thu Jul 28 05:23:38 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:23:41.327977 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-b75b28e2-1b8f-4a6b-87c4-f02b67533428 admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:23:41.328913 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-b75b28e2-1b8f-4a6b-87c4-f02b67533428 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Jul 28 05:23:41.329306 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 3/7] 10.222.0.33 () {54 vars in 930 bytes} [Thu Jul 28 05:23:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:23:41.983491 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-09138a9b-d8c0-456e-abf8-f7a37a43b869 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "disk": 5, "rxtx_factor": 1.0, "swap": 0, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "name": "ds512M"}} {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:23:42.007339 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 05:23:42.007339 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: warnings.warn(msg) Jul 28 05:23:42.136817 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-09138a9b-d8c0-456e-abf8-f7a37a43b869 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.801215 Jul 28 05:23:42.137527 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 5/8] 10.222.0.33 () {64 vars in 1282 bytes} [Thu Jul 28 05:23:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 05:23:42.151636 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-e67cc168-cf6e-4244-b49d-cadce7406fea admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:23:42.155613 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 05:23:42.155613 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: warnings.warn(msg) Jul 28 05:23:42.244246 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-e67cc168-cf6e-4244-b49d-cadce7406fea admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097241 Jul 28 05:23:42.245005 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 4/9] 10.222.0.33 () {64 vars in 1335 bytes} [Thu Jul 28 05:23:42 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:23:44.519274 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-09138a9b-d8c0-456e-abf8-f7a37a43b869 admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:23:44.520284 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-09138a9b-d8c0-456e-abf8-f7a37a43b869 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jul 28 05:23:44.520684 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 6/10] 10.222.0.33 () {54 vars in 930 bytes} [Thu Jul 28 05:23:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:23:44.921150 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-a5dba5c7-e420-4452-bd30-bd824e41994e admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 1024, "name": "ds1G", "id": "d2"}} {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:23:44.990454 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-a5dba5c7-e420-4452-bd30-bd824e41994e admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.463821 Jul 28 05:23:44.991007 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 5/11] 10.222.0.33 () {64 vars in 1282 bytes} [Thu Jul 28 05:23:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 05:23:45.003719 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-08ae24cb-e234-4c04-aa9b-0d8a0de7e283 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:23:45.099943 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-08ae24cb-e234-4c04-aa9b-0d8a0de7e283 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.099865 Jul 28 05:23:45.100528 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 7/12] 10.222.0.33 () {64 vars in 1335 bytes} [Thu Jul 28 05:23:44 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:23:47.356607 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-a5dba5c7-e420-4452-bd30-bd824e41994e admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:23:47.357628 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-a5dba5c7-e420-4452-bd30-bd824e41994e admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Jul 28 05:23:47.358016 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 6/13] 10.222.0.33 () {54 vars in 930 bytes} [Thu Jul 28 05:23:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:23:47.829433 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-e47076a1-2760-46b4-9a42-e3209e21f970 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "rxtx_factor": 1.0, "ram": 2048, "os-flavor-access:is_public": true, "name": "ds2G", "vcpus": 2}} {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:23:47.903247 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-e47076a1-2760-46b4-9a42-e3209e21f970 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.539498 Jul 28 05:23:47.904311 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 8/14] 10.222.0.33 () {64 vars in 1282 bytes} [Thu Jul 28 05:23:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 05:23:47.916968 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-77a1ca1b-0550-48ba-b4e7-1febdd7c70c7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:23:47.995520 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-77a1ca1b-0550-48ba-b4e7-1febdd7c70c7 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.082867 Jul 28 05:23:47.996106 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 7/15] 10.222.0.33 () {64 vars in 1335 bytes} [Thu Jul 28 05:23:47 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:23:50.224241 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-e47076a1-2760-46b4-9a42-e3209e21f970 admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:23:50.225168 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-e47076a1-2760-46b4-9a42-e3209e21f970 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Jul 28 05:23:50.225589 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 9/16] 10.222.0.33 () {54 vars in 930 bytes} [Thu Jul 28 05:23:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:23:50.685569 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-ef5ec86a-fa4c-4014-9268-62cc06640e31 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 20, "name": "ds4G", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "ram": 4096, "vcpus": 4}} {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:23:50.804953 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-ef5ec86a-fa4c-4014-9268-62cc06640e31 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.572533 Jul 28 05:23:50.806458 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 8/17] 10.222.0.33 () {64 vars in 1282 bytes} [Thu Jul 28 05:23:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 05:23:50.818410 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-e2755408-fa9a-4647-8468-48a3a0e48d58 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:23:51.046316 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-e2755408-fa9a-4647-8468-48a3a0e48d58 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.231262 Jul 28 05:23:51.054810 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 10/18] 10.222.0.33 () {64 vars in 1335 bytes} [Thu Jul 28 05:23:50 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:23:53.466701 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-ef5ec86a-fa4c-4014-9268-62cc06640e31 admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:23:53.467771 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-ef5ec86a-fa4c-4014-9268-62cc06640e31 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Jul 28 05:23:53.468113 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 9/19] 10.222.0.33 () {54 vars in 930 bytes} [Thu Jul 28 05:23:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:23:53.914085 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-9b9be548-bc93-4f87-997c-3d131d5f69cb admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:23:53.940905 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-9b9be548-bc93-4f87-997c-3d131d5f69cb admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.466507 Jul 28 05:23:53.941494 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 11/20] 10.222.0.33 () {60 vars in 1291 bytes} [Thu Jul 28 05:23:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:23:56.203789 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-ef5ec86a-fa4c-4014-9268-62cc06640e31 admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:23:56.204730 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-ef5ec86a-fa4c-4014-9268-62cc06640e31 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Jul 28 05:23:56.205182 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 10/21] 10.222.0.33 () {54 vars in 930 bytes} [Thu Jul 28 05:23:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:23:56.634309 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-5590ab2e-0600-4502-b01b-95c8eed2c8b9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "1", "name": "m1.tiny", "vcpus": 1, "disk": 1}} {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:23:56.702480 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-5590ab2e-0600-4502-b01b-95c8eed2c8b9 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.491549 Jul 28 05:23:56.703231 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 12/22] 10.222.0.33 () {64 vars in 1282 bytes} [Thu Jul 28 05:23:56 2022] POST /compute/v2.1/flavors => generated 402 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 05:23:56.715608 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-86642d16-479d-4277-a22f-60ae25ed4eee admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:23:56.819942 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-86642d16-479d-4277-a22f-60ae25ed4eee admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.108066 Jul 28 05:23:56.820569 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 11/23] 10.222.0.33 () {64 vars in 1332 bytes} [Thu Jul 28 05:23:56 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:23:59.121576 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-5590ab2e-0600-4502-b01b-95c8eed2c8b9 admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:23:59.122590 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-5590ab2e-0600-4502-b01b-95c8eed2c8b9 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Jul 28 05:23:59.123176 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 13/24] 10.222.0.33 () {54 vars in 930 bytes} [Thu Jul 28 05:23:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:23:59.522957 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-a5e6b041-8cb5-45ad-ad28-507785079c43 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.small", "vcpus": 1, "os-flavor-access:is_public": true, "ram": 2048, "rxtx_factor": 1.0}} {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:23:59.595684 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-a5e6b041-8cb5-45ad-ad28-507785079c43 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.466839 Jul 28 05:23:59.596238 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 12/25] 10.222.0.33 () {64 vars in 1282 bytes} [Thu Jul 28 05:23:59 2022] POST /compute/v2.1/flavors => generated 405 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 05:23:59.608870 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-a6bed6f3-7d09-4b08-aecd-f7042c75c900 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:23:59.684481 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-a6bed6f3-7d09-4b08-aecd-f7042c75c900 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.074736 Jul 28 05:23:59.684481 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 14/26] 10.222.0.33 () {64 vars in 1332 bytes} [Thu Jul 28 05:23:59 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:24:01.919342 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-a5e6b041-8cb5-45ad-ad28-507785079c43 admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:24:01.920597 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-a5e6b041-8cb5-45ad-ad28-507785079c43 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002019 Jul 28 05:24:01.920597 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 13/27] 10.222.0.33 () {54 vars in 930 bytes} [Thu Jul 28 05:24:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 05:24:02.294161 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-f2305446-2f80-4c14-930c-870f09a46c92 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "id": "3", "swap": 0, "ram": 4096, "os-flavor-access:is_public": true, "vcpus": 2, "disk": 40}} {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:24:02.356082 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-f2305446-2f80-4c14-930c-870f09a46c92 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.429484 Jul 28 05:24:02.356253 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 15/28] 10.222.0.33 () {64 vars in 1282 bytes} [Thu Jul 28 05:24:01 2022] POST /compute/v2.1/flavors => generated 406 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 05:24:02.369031 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-311cb36b-466d-438e-8e0c-f5878110cc21 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:24:02.463466 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-311cb36b-466d-438e-8e0c-f5878110cc21 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.098852 Jul 28 05:24:02.474123 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 14/29] 10.222.0.33 () {64 vars in 1332 bytes} [Thu Jul 28 05:24:02 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:24:04.671453 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-f2305446-2f80-4c14-930c-870f09a46c92 admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:24:04.672459 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-f2305446-2f80-4c14-930c-870f09a46c92 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jul 28 05:24:04.672856 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 16/30] 10.222.0.33 () {54 vars in 930 bytes} [Thu Jul 28 05:24:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:24:05.136055 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-b966fc4b-c320-43ac-8ae7-46ef66d82573 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 4, "ram": 8192, "id": "4", "rxtx_factor": 1.0, "disk": 80, "name": "m1.large"}} {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:24:05.144340 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG dbcounter [-] [103524] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:24:05.210392 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-b966fc4b-c320-43ac-8ae7-46ef66d82573 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.531299 Jul 28 05:24:05.211487 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 15/31] 10.222.0.33 () {64 vars in 1282 bytes} [Thu Jul 28 05:24:04 2022] POST /compute/v2.1/flavors => generated 405 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 05:24:05.223753 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-93280444-8b86-4f00-9063-b2f74e07ec49 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:24:05.319951 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-93280444-8b86-4f00-9063-b2f74e07ec49 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.099789 Jul 28 05:24:05.320515 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 17/32] 10.222.0.33 () {64 vars in 1332 bytes} [Thu Jul 28 05:24:05 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:24:07.650210 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-b966fc4b-c320-43ac-8ae7-46ef66d82573 admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:24:07.651232 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-b966fc4b-c320-43ac-8ae7-46ef66d82573 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001554 Jul 28 05:24:07.651638 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 16/33] 10.222.0.33 () {54 vars in 930 bytes} [Thu Jul 28 05:24:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:24:08.220216 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-8adc1f2b-c124-4b46-b081-59e354e51f7d admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "id": "5", "rxtx_factor": 1.0, "disk": 160, "ram": 16384, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:24:08.349743 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-8adc1f2b-c124-4b46-b081-59e354e51f7d admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.692153 Jul 28 05:24:08.358025 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 18/34] 10.222.0.33 () {64 vars in 1282 bytes} [Thu Jul 28 05:24:07 2022] POST /compute/v2.1/flavors => generated 408 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 05:24:08.363623 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-78b7092b-11bd-49c2-a2a9-c69a67251ede admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:24:08.437805 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-78b7092b-11bd-49c2-a2a9-c69a67251ede admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.078500 Jul 28 05:24:08.439024 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 17/35] 10.222.0.33 () {64 vars in 1332 bytes} [Thu Jul 28 05:24:08 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:24:28.687826 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-8adc1f2b-c124-4b46-b081-59e354e51f7d admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:24:28.688829 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-8adc1f2b-c124-4b46-b081-59e354e51f7d admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Jul 28 05:24:28.689228 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 19/36] 10.222.0.33 () {54 vars in 930 bytes} [Thu Jul 28 05:24:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:24:29.080104 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-c53a2e10-e1f2-4294-8dc7-f169b589c22d admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:24:29.098262 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-c53a2e10-e1f2-4294-8dc7-f169b589c22d admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.403319 Jul 28 05:24:29.098762 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 18/37] 10.222.0.33 () {60 vars in 1291 bytes} [Thu Jul 28 05:24:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:24:30.161535 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-8adc1f2b-c124-4b46-b081-59e354e51f7d admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:24:30.162599 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-8adc1f2b-c124-4b46-b081-59e354e51f7d admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jul 28 05:24:30.162998 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 20/38] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Jul 28 05:24:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:24:30.683016 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-6434dad9-a352-471d-ae02-57191ddbff63 admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:24:30.688591 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.wsgi [None req-6434dad9-a352-471d-ae02-57191ddbff63 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 28 05:24:30.691843 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-6434dad9-a352-471d-ae02-57191ddbff63 admin admin] Request method failure captured: Jul 28 05:24:30.691843 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 28 05:24:30.691843 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: Accept: application/json Jul 28 05:24:30.691843 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: Accept-Encoding: gzip, deflate Jul 28 05:24:30.691843 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: Connection: keep-alive Jul 28 05:24:30.691843 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: Content-Length: 0 Jul 28 05:24:30.691843 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: Host: 10.222.0.33 Jul 28 05:24:30.691843 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: Openstack-Api-Version: compute 2.90 Jul 28 05:24:30.691843 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: Openstack-System-Scope: None Jul 28 05:24:30.691843 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: User-Agent: python-novaclient Jul 28 05:24:30.691843 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: X-Auth-Token: gAAAAABi4h2OlV9bva4ljufN49rkuRWlS7jfoZTTAhLR5Q7ESqyEP10gqE6U4PKkM9uwETsj9MztQgXZV2Q8PToMty0gLK3NG13S6c23nM2aawziu2gOl3drD_8zsH7yUnPfXSJkOIcENxYWOLPMr32SQatHQje68yq5cqg5SzAhjsdEZNekUHo Jul 28 05:24:30.691843 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: X-Domain-Id: None Jul 28 05:24:30.691843 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: X-Domain-Name: None Jul 28 05:24:30.691843 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: X-Identity-Status: Confirmed Jul 28 05:24:30.691843 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: X-Is-Admin-Project: True Jul 28 05:24:30.691843 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 05:24:30.691843 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: X-Project-Domain-Id: default Jul 28 05:24:30.691843 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: X-Project-Domain-Name: Default Jul 28 05:24:30.691843 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: X-Project-Id: 44e83cd79a56499f92e288b2c69de397 Jul 28 05:24:30.691843 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: X-Project-Name: admin Jul 28 05:24:30.691843 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: X-Role: admin,member,reader Jul 28 05:24:30.691843 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: X-Roles: admin,member,reader Jul 28 05:24:30.693514 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/44e83cd79a56499f92e288b2c69de397"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/44e83cd79a56499f92e288b2c69de397"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_44e83cd79a56499f92e288b2c69de397", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/44e83cd79a56499f92e288b2c69de397"}]}] Jul 28 05:24:30.693514 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: X-Tenant: admin Jul 28 05:24:30.693514 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: X-Tenant-Id: 44e83cd79a56499f92e288b2c69de397 Jul 28 05:24:30.693514 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: X-Tenant-Name: admin Jul 28 05:24:30.693514 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: X-User: admin Jul 28 05:24:30.693514 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: X-User-Domain-Id: default Jul 28 05:24:30.693514 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: X-User-Domain-Name: Default Jul 28 05:24:30.693514 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: X-User-Id: 40170d20cf2e4d67929f88ba378a2373 Jul 28 05:24:30.693514 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: X-User-Name: admin Jul 28 05:24:30.693514 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: method: > Jul 28 05:24:30.693514 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: exception: Flavor 42 could not be found. Jul 28 05:24:30.693514 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: action_args: {'id': '42'} Jul 28 05:24:30.693514 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 05:24:30.693514 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:24:30.694760 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 05:24:30.694760 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 05:24:30.694760 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 05:24:30.694760 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 05:24:30.694760 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 05:24:30.694760 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 05:24:30.694760 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 05:24:30.694760 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 05:24:30.694760 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 05:24:30.694760 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:24:30.694760 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 05:24:30.694760 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 05:24:30.694760 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 28 05:24:30.694760 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi Jul 28 05:24:30.694760 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:24:30.694760 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi Jul 28 05:24:30.694760 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:24:30.694760 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:24:30.694760 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:24:30.696276 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 05:24:30.696276 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 05:24:30.696276 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 05:24:30.696276 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:24:30.696276 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 05:24:30.696276 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 05:24:30.696276 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 28 05:24:30.696276 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi Jul 28 05:24:30.696276 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:24:30.696276 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi Jul 28 05:24:30.696276 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:24:30.696276 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:24:30.696276 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:24:30.696276 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 05:24:30.696276 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 05:24:30.696276 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 28 05:24:30.696276 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi Jul 28 05:24:30.696276 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-6434dad9-a352-471d-ae02-57191ddbff63 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 05:24:30.697597 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-6434dad9-a352-471d-ae02-57191ddbff63 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.393740 Jul 28 05:24:30.697597 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 19/39] 10.222.0.33 () {60 vars in 1190 bytes} [Thu Jul 28 05:24:30 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 05:24:30.702994 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-8b7d896b-db14-4e26-9d7c-deed4e046a98 admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:24:30.707240 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG dbcounter [-] [103523] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:24:30.726134 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-8b7d896b-db14-4e26-9d7c-deed4e046a98 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026700 Jul 28 05:24:30.727401 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 21/40] 10.222.0.33 () {60 vars in 1210 bytes} [Thu Jul 28 05:24:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:24:30.737204 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-a54cf9ab-35c0-4f9d-a6c8-94405efa6247 admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:24:30.761262 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-a54cf9ab-35c0-4f9d-a6c8-94405efa6247 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027698 Jul 28 05:24:30.761837 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 20/41] 10.222.0.33 () {60 vars in 1210 bytes} [Thu Jul 28 05:24:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 05:24:30.771406 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-790fc05f-ac30-495c-af2e-81e55be801fa admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:24:30.777761 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.wsgi [None req-790fc05f-ac30-495c-af2e-81e55be801fa admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 28 05:24:30.780981 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-790fc05f-ac30-495c-af2e-81e55be801fa admin admin] Request method failure captured: Jul 28 05:24:30.780981 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 28 05:24:30.780981 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: Accept: application/json Jul 28 05:24:30.780981 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: Accept-Encoding: gzip, deflate Jul 28 05:24:30.780981 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: Connection: keep-alive Jul 28 05:24:30.780981 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: Content-Length: 0 Jul 28 05:24:30.780981 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: Host: 10.222.0.33 Jul 28 05:24:30.780981 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: Openstack-Api-Version: compute 2.90 Jul 28 05:24:30.780981 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: Openstack-System-Scope: None Jul 28 05:24:30.780981 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: User-Agent: python-novaclient Jul 28 05:24:30.780981 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: X-Auth-Token: gAAAAABi4h2OlV9bva4ljufN49rkuRWlS7jfoZTTAhLR5Q7ESqyEP10gqE6U4PKkM9uwETsj9MztQgXZV2Q8PToMty0gLK3NG13S6c23nM2aawziu2gOl3drD_8zsH7yUnPfXSJkOIcENxYWOLPMr32SQatHQje68yq5cqg5SzAhjsdEZNekUHo Jul 28 05:24:30.780981 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: X-Domain-Id: None Jul 28 05:24:30.780981 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: X-Domain-Name: None Jul 28 05:24:30.780981 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: X-Identity-Status: Confirmed Jul 28 05:24:30.780981 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: X-Is-Admin-Project: True Jul 28 05:24:30.780981 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 05:24:30.780981 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: X-Project-Domain-Id: default Jul 28 05:24:30.780981 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: X-Project-Domain-Name: Default Jul 28 05:24:30.780981 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: X-Project-Id: 44e83cd79a56499f92e288b2c69de397 Jul 28 05:24:30.780981 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: X-Project-Name: admin Jul 28 05:24:30.780981 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: X-Role: admin,member,reader Jul 28 05:24:30.780981 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: X-Roles: admin,member,reader Jul 28 05:24:30.785831 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/44e83cd79a56499f92e288b2c69de397"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/44e83cd79a56499f92e288b2c69de397"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_44e83cd79a56499f92e288b2c69de397", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/44e83cd79a56499f92e288b2c69de397"}]}] Jul 28 05:24:30.785831 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: X-Tenant: admin Jul 28 05:24:30.785831 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: X-Tenant-Id: 44e83cd79a56499f92e288b2c69de397 Jul 28 05:24:30.785831 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: X-Tenant-Name: admin Jul 28 05:24:30.785831 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: X-User: admin Jul 28 05:24:30.785831 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: X-User-Domain-Id: default Jul 28 05:24:30.785831 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: X-User-Domain-Name: Default Jul 28 05:24:30.785831 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: X-User-Id: 40170d20cf2e4d67929f88ba378a2373 Jul 28 05:24:30.785831 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: X-User-Name: admin Jul 28 05:24:30.785831 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: method: > Jul 28 05:24:30.785831 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: exception: Flavor 42 could not be found. Jul 28 05:24:30.785831 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: action_args: {'id': '42'} Jul 28 05:24:30.785831 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 05:24:30.785831 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:24:30.786954 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 05:24:30.786954 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 05:24:30.786954 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 05:24:30.786954 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 05:24:30.786954 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 05:24:30.786954 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 05:24:30.786954 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 05:24:30.786954 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 05:24:30.786954 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 05:24:30.786954 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:24:30.786954 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 05:24:30.786954 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 05:24:30.786954 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 28 05:24:30.786954 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Jul 28 05:24:30.786954 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:24:30.786954 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Jul 28 05:24:30.786954 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:24:30.786954 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:24:30.786954 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:24:30.788297 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 05:24:30.788297 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 05:24:30.788297 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 05:24:30.788297 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:24:30.788297 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 05:24:30.788297 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 05:24:30.788297 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 28 05:24:30.788297 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Jul 28 05:24:30.788297 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:24:30.788297 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Jul 28 05:24:30.788297 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:24:30.788297 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:24:30.788297 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:24:30.788297 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 05:24:30.788297 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 05:24:30.788297 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 28 05:24:30.788297 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Jul 28 05:24:30.788297 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-790fc05f-ac30-495c-af2e-81e55be801fa admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 05:24:30.790382 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-790fc05f-ac30-495c-af2e-81e55be801fa admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014906 Jul 28 05:24:30.790382 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 22/42] 10.222.0.33 () {60 vars in 1190 bytes} [Thu Jul 28 05:24:30 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 05:24:31.738665 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-a54cf9ab-35c0-4f9d-a6c8-94405efa6247 admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:24:31.739679 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-a54cf9ab-35c0-4f9d-a6c8-94405efa6247 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jul 28 05:24:31.740069 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 21/43] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Jul 28 05:24:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:24:32.260768 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-17d95e96-7ffd-41f2-8586-aa4252bab555 admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:24:32.266226 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.wsgi [None req-17d95e96-7ffd-41f2-8586-aa4252bab555 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 28 05:24:32.267721 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-17d95e96-7ffd-41f2-8586-aa4252bab555 admin admin] Request method failure captured: Jul 28 05:24:32.267721 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 28 05:24:32.267721 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: Accept: application/json Jul 28 05:24:32.267721 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: Accept-Encoding: gzip, deflate Jul 28 05:24:32.267721 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: Connection: keep-alive Jul 28 05:24:32.267721 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: Content-Length: 0 Jul 28 05:24:32.267721 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: Host: 10.222.0.33 Jul 28 05:24:32.267721 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: Openstack-Api-Version: compute 2.90 Jul 28 05:24:32.267721 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: Openstack-System-Scope: None Jul 28 05:24:32.267721 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: User-Agent: python-novaclient Jul 28 05:24:32.267721 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: X-Auth-Token: gAAAAABi4h2P_W5TzEwA0qmGPtuXGL2BiJXVCL1jPhxYPb8booAkOc6PnVk2a5ZrdJNGyjNOMjmM_J3ftw3z8Kt6eVI59iX_rJB7EKUK1veBoPF61Uc3rIexbnUUzUIVTAYG1yOX4Iq5RcxqGNv7_6QoJ-3tkoJm4NKs9bD8IeUfB3rLGuZTcyU Jul 28 05:24:32.267721 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: X-Domain-Id: None Jul 28 05:24:32.267721 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: X-Domain-Name: None Jul 28 05:24:32.267721 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: X-Identity-Status: Confirmed Jul 28 05:24:32.267721 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: X-Is-Admin-Project: True Jul 28 05:24:32.267721 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 05:24:32.267721 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: X-Project-Domain-Id: default Jul 28 05:24:32.267721 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: X-Project-Domain-Name: Default Jul 28 05:24:32.267721 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: X-Project-Id: 44e83cd79a56499f92e288b2c69de397 Jul 28 05:24:32.267721 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: X-Project-Name: admin Jul 28 05:24:32.267721 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: X-Role: admin,member,reader Jul 28 05:24:32.267721 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: X-Roles: admin,member,reader Jul 28 05:24:32.269304 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/44e83cd79a56499f92e288b2c69de397"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/44e83cd79a56499f92e288b2c69de397"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_44e83cd79a56499f92e288b2c69de397", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/44e83cd79a56499f92e288b2c69de397"}]}] Jul 28 05:24:32.269304 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: X-Tenant: admin Jul 28 05:24:32.269304 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: X-Tenant-Id: 44e83cd79a56499f92e288b2c69de397 Jul 28 05:24:32.269304 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: X-Tenant-Name: admin Jul 28 05:24:32.269304 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: X-User: admin Jul 28 05:24:32.269304 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: X-User-Domain-Id: default Jul 28 05:24:32.269304 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: X-User-Domain-Name: Default Jul 28 05:24:32.269304 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: X-User-Id: 40170d20cf2e4d67929f88ba378a2373 Jul 28 05:24:32.269304 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: X-User-Name: admin Jul 28 05:24:32.269304 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: method: > Jul 28 05:24:32.269304 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: exception: Flavor 84 could not be found. Jul 28 05:24:32.269304 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: action_args: {'id': '84'} Jul 28 05:24:32.269304 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 05:24:32.269304 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:24:32.270431 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 05:24:32.270431 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 05:24:32.270431 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 05:24:32.270431 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 05:24:32.270431 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 05:24:32.270431 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 05:24:32.270431 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 05:24:32.270431 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 05:24:32.270431 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 05:24:32.270431 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:24:32.270431 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 05:24:32.270431 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 05:24:32.270431 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 28 05:24:32.270431 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Jul 28 05:24:32.270431 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:24:32.270431 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Jul 28 05:24:32.270431 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:24:32.270431 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:24:32.270431 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:24:32.271837 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 05:24:32.271837 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 05:24:32.271837 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 05:24:32.271837 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:24:32.271837 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 05:24:32.271837 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 05:24:32.271837 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 28 05:24:32.271837 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Jul 28 05:24:32.271837 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:24:32.271837 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Jul 28 05:24:32.271837 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:24:32.271837 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:24:32.271837 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:24:32.271837 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 05:24:32.271837 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 05:24:32.271837 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 28 05:24:32.271837 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Jul 28 05:24:32.271837 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-17d95e96-7ffd-41f2-8586-aa4252bab555 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 05:24:32.273649 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-17d95e96-7ffd-41f2-8586-aa4252bab555 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.389074 Jul 28 05:24:32.273649 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 23/44] 10.222.0.33 () {60 vars in 1190 bytes} [Thu Jul 28 05:24:31 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 05:24:32.279561 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-06bd294b-c8b8-4fdb-baa6-c5e02ff93487 admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:24:32.295375 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-06bd294b-c8b8-4fdb-baa6-c5e02ff93487 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019435 Jul 28 05:24:32.295894 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 22/45] 10.222.0.33 () {60 vars in 1210 bytes} [Thu Jul 28 05:24:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:24:32.305021 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-f5564067-c880-4d1d-bae5-de629c4ed363 admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:24:32.319741 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-f5564067-c880-4d1d-bae5-de629c4ed363 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018176 Jul 28 05:24:32.320258 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 24/46] 10.222.0.33 () {60 vars in 1210 bytes} [Thu Jul 28 05:24:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:24:32.329091 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-ec206fc4-6528-499b-8d78-a3b962af81db admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:24:32.334364 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.wsgi [None req-ec206fc4-6528-499b-8d78-a3b962af81db admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 28 05:24:32.336359 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-ec206fc4-6528-499b-8d78-a3b962af81db admin admin] Request method failure captured: Jul 28 05:24:32.336359 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 28 05:24:32.336359 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: Accept: application/json Jul 28 05:24:32.336359 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: Accept-Encoding: gzip, deflate Jul 28 05:24:32.336359 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: Connection: keep-alive Jul 28 05:24:32.336359 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: Content-Length: 0 Jul 28 05:24:32.336359 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: Host: 10.222.0.33 Jul 28 05:24:32.336359 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: Openstack-Api-Version: compute 2.90 Jul 28 05:24:32.336359 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: Openstack-System-Scope: None Jul 28 05:24:32.336359 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: User-Agent: python-novaclient Jul 28 05:24:32.336359 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: X-Auth-Token: gAAAAABi4h2P_W5TzEwA0qmGPtuXGL2BiJXVCL1jPhxYPb8booAkOc6PnVk2a5ZrdJNGyjNOMjmM_J3ftw3z8Kt6eVI59iX_rJB7EKUK1veBoPF61Uc3rIexbnUUzUIVTAYG1yOX4Iq5RcxqGNv7_6QoJ-3tkoJm4NKs9bD8IeUfB3rLGuZTcyU Jul 28 05:24:32.336359 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: X-Domain-Id: None Jul 28 05:24:32.336359 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: X-Domain-Name: None Jul 28 05:24:32.336359 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: X-Identity-Status: Confirmed Jul 28 05:24:32.336359 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: X-Is-Admin-Project: True Jul 28 05:24:32.336359 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 05:24:32.336359 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: X-Project-Domain-Id: default Jul 28 05:24:32.336359 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: X-Project-Domain-Name: Default Jul 28 05:24:32.336359 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: X-Project-Id: 44e83cd79a56499f92e288b2c69de397 Jul 28 05:24:32.336359 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: X-Project-Name: admin Jul 28 05:24:32.336359 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: X-Role: admin,member,reader Jul 28 05:24:32.336359 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: X-Roles: admin,member,reader Jul 28 05:24:32.337951 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/44e83cd79a56499f92e288b2c69de397"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/44e83cd79a56499f92e288b2c69de397"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_44e83cd79a56499f92e288b2c69de397", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/44e83cd79a56499f92e288b2c69de397"}]}] Jul 28 05:24:32.337951 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: X-Tenant: admin Jul 28 05:24:32.337951 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: X-Tenant-Id: 44e83cd79a56499f92e288b2c69de397 Jul 28 05:24:32.337951 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: X-Tenant-Name: admin Jul 28 05:24:32.337951 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: X-User: admin Jul 28 05:24:32.337951 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: X-User-Domain-Id: default Jul 28 05:24:32.337951 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: X-User-Domain-Name: Default Jul 28 05:24:32.337951 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: X-User-Id: 40170d20cf2e4d67929f88ba378a2373 Jul 28 05:24:32.337951 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: X-User-Name: admin Jul 28 05:24:32.337951 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: method: > Jul 28 05:24:32.337951 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: exception: Flavor 84 could not be found. Jul 28 05:24:32.337951 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: action_args: {'id': '84'} Jul 28 05:24:32.337951 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 05:24:32.337951 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:24:32.338994 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 05:24:32.338994 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 05:24:32.338994 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 05:24:32.338994 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 05:24:32.338994 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 05:24:32.338994 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 05:24:32.338994 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 05:24:32.338994 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 05:24:32.338994 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 05:24:32.338994 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:24:32.338994 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 05:24:32.338994 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 05:24:32.338994 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 28 05:24:32.338994 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi Jul 28 05:24:32.338994 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:24:32.338994 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi Jul 28 05:24:32.338994 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:24:32.338994 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:24:32.338994 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:24:32.340440 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 05:24:32.340440 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 05:24:32.340440 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 05:24:32.340440 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:24:32.340440 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 05:24:32.340440 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 05:24:32.340440 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 28 05:24:32.340440 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi Jul 28 05:24:32.340440 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:24:32.340440 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi Jul 28 05:24:32.340440 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:24:32.340440 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:24:32.340440 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:24:32.340440 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 05:24:32.340440 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 05:24:32.340440 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 28 05:24:32.340440 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi Jul 28 05:24:32.340440 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-ec206fc4-6528-499b-8d78-a3b962af81db admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 05:24:32.341736 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-ec206fc4-6528-499b-8d78-a3b962af81db admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012270 Jul 28 05:24:32.341736 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 23/47] 10.222.0.33 () {60 vars in 1190 bytes} [Thu Jul 28 05:24:32 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 05:24:33.301097 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-f5564067-c880-4d1d-bae5-de629c4ed363 admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:24:33.302120 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-f5564067-c880-4d1d-bae5-de629c4ed363 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jul 28 05:24:33.302514 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 25/48] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Jul 28 05:24:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:24:33.827389 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-253007df-d902-43dd-a157-203617ef1981 admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:24:33.833059 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.wsgi [None req-253007df-d902-43dd-a157-203617ef1981 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 28 05:24:33.834599 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-253007df-d902-43dd-a157-203617ef1981 admin admin] Request method failure captured: Jul 28 05:24:33.834599 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 28 05:24:33.834599 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: Accept: application/json Jul 28 05:24:33.834599 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: Accept-Encoding: gzip, deflate Jul 28 05:24:33.834599 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: Connection: keep-alive Jul 28 05:24:33.834599 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: Content-Length: 0 Jul 28 05:24:33.834599 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: Host: 10.222.0.33 Jul 28 05:24:33.834599 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: Openstack-Api-Version: compute 2.90 Jul 28 05:24:33.834599 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: Openstack-System-Scope: None Jul 28 05:24:33.834599 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: User-Agent: python-novaclient Jul 28 05:24:33.834599 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: X-Auth-Token: gAAAAABi4h2R2WgajvvrWEHSQAoqV-nyAGFcGPig0XAVovOzefE3-uaySQEUt08gUdERHmBkdpIfQ8UZPEXCYytJNwL7Y7hrWJuGMhZ3TxUW3vYrkohhkYw3a2lr_WSZzhZxUiUTjVsAh2w_AQi3BWVT9KxoDAvFUWx6ojrBB5cEc6tI6dnIhKY Jul 28 05:24:33.834599 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: X-Domain-Id: None Jul 28 05:24:33.834599 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: X-Domain-Name: None Jul 28 05:24:33.834599 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: X-Identity-Status: Confirmed Jul 28 05:24:33.834599 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: X-Is-Admin-Project: True Jul 28 05:24:33.834599 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 05:24:33.834599 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: X-Project-Domain-Id: default Jul 28 05:24:33.834599 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: X-Project-Domain-Name: Default Jul 28 05:24:33.834599 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: X-Project-Id: 44e83cd79a56499f92e288b2c69de397 Jul 28 05:24:33.834599 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: X-Project-Name: admin Jul 28 05:24:33.834599 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: X-Role: admin,member,reader Jul 28 05:24:33.834599 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: X-Roles: admin,member,reader Jul 28 05:24:33.836714 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/44e83cd79a56499f92e288b2c69de397"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/44e83cd79a56499f92e288b2c69de397"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_44e83cd79a56499f92e288b2c69de397", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/44e83cd79a56499f92e288b2c69de397"}]}] Jul 28 05:24:33.836714 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: X-Tenant: admin Jul 28 05:24:33.836714 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: X-Tenant-Id: 44e83cd79a56499f92e288b2c69de397 Jul 28 05:24:33.836714 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: X-Tenant-Name: admin Jul 28 05:24:33.836714 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: X-User: admin Jul 28 05:24:33.836714 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: X-User-Domain-Id: default Jul 28 05:24:33.836714 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: X-User-Domain-Name: Default Jul 28 05:24:33.836714 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: X-User-Id: 40170d20cf2e4d67929f88ba378a2373 Jul 28 05:24:33.836714 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: X-User-Name: admin Jul 28 05:24:33.836714 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: method: > Jul 28 05:24:33.836714 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: exception: Flavor 451 could not be found. Jul 28 05:24:33.836714 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: action_args: {'id': '451'} Jul 28 05:24:33.836714 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 05:24:33.836714 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:24:33.837550 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 05:24:33.837550 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 05:24:33.837550 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 05:24:33.837550 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 05:24:33.837550 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 05:24:33.837550 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 05:24:33.837550 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 05:24:33.837550 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 05:24:33.837550 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 05:24:33.837550 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:24:33.837550 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 05:24:33.837550 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 05:24:33.837550 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 28 05:24:33.837550 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi Jul 28 05:24:33.837550 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:24:33.837550 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi Jul 28 05:24:33.837550 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:24:33.837550 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:24:33.837550 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:24:33.838608 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 05:24:33.838608 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 05:24:33.838608 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 05:24:33.838608 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:24:33.838608 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 05:24:33.838608 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 05:24:33.838608 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 28 05:24:33.838608 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi Jul 28 05:24:33.838608 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:24:33.838608 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi Jul 28 05:24:33.838608 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:24:33.838608 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:24:33.838608 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:24:33.838608 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 05:24:33.838608 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 05:24:33.838608 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 28 05:24:33.838608 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi Jul 28 05:24:33.838608 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-253007df-d902-43dd-a157-203617ef1981 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 05:24:33.839629 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-253007df-d902-43dd-a157-203617ef1981 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.393563 Jul 28 05:24:33.839629 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 24/49] 10.222.0.33 () {60 vars in 1193 bytes} [Thu Jul 28 05:24:33 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 05:24:33.846230 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-21809821-2a22-4e1b-9503-53eb301bbebc admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:24:33.861909 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-21809821-2a22-4e1b-9503-53eb301bbebc admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019120 Jul 28 05:24:33.863537 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 26/50] 10.222.0.33 () {60 vars in 1210 bytes} [Thu Jul 28 05:24:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:24:33.872220 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-54b0712a-6af1-4a60-bbf3-095474d6936e admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:24:33.887054 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-54b0712a-6af1-4a60-bbf3-095474d6936e admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018397 Jul 28 05:24:33.892477 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 25/51] 10.222.0.33 () {60 vars in 1210 bytes} [Thu Jul 28 05:24:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:24:33.901014 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-d31ef7a3-6247-406f-b43f-588c55f81c13 admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:24:33.906362 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.wsgi [None req-d31ef7a3-6247-406f-b43f-588c55f81c13 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 28 05:24:33.907841 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-d31ef7a3-6247-406f-b43f-588c55f81c13 admin admin] Request method failure captured: Jul 28 05:24:33.907841 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 28 05:24:33.907841 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: Accept: application/json Jul 28 05:24:33.907841 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: Accept-Encoding: gzip, deflate Jul 28 05:24:33.907841 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: Connection: keep-alive Jul 28 05:24:33.907841 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: Content-Length: 0 Jul 28 05:24:33.907841 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: Host: 10.222.0.33 Jul 28 05:24:33.907841 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: Openstack-Api-Version: compute 2.90 Jul 28 05:24:33.907841 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: Openstack-System-Scope: None Jul 28 05:24:33.907841 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: User-Agent: python-novaclient Jul 28 05:24:33.907841 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: X-Auth-Token: gAAAAABi4h2R2WgajvvrWEHSQAoqV-nyAGFcGPig0XAVovOzefE3-uaySQEUt08gUdERHmBkdpIfQ8UZPEXCYytJNwL7Y7hrWJuGMhZ3TxUW3vYrkohhkYw3a2lr_WSZzhZxUiUTjVsAh2w_AQi3BWVT9KxoDAvFUWx6ojrBB5cEc6tI6dnIhKY Jul 28 05:24:33.907841 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: X-Domain-Id: None Jul 28 05:24:33.907841 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: X-Domain-Name: None Jul 28 05:24:33.907841 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: X-Identity-Status: Confirmed Jul 28 05:24:33.907841 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: X-Is-Admin-Project: True Jul 28 05:24:33.907841 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 05:24:33.907841 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: X-Project-Domain-Id: default Jul 28 05:24:33.907841 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: X-Project-Domain-Name: Default Jul 28 05:24:33.907841 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: X-Project-Id: 44e83cd79a56499f92e288b2c69de397 Jul 28 05:24:33.907841 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: X-Project-Name: admin Jul 28 05:24:33.907841 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: X-Role: admin,member,reader Jul 28 05:24:33.907841 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: X-Roles: admin,member,reader Jul 28 05:24:33.909409 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/44e83cd79a56499f92e288b2c69de397"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/44e83cd79a56499f92e288b2c69de397"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_44e83cd79a56499f92e288b2c69de397", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/44e83cd79a56499f92e288b2c69de397"}]}] Jul 28 05:24:33.909409 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: X-Tenant: admin Jul 28 05:24:33.909409 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: X-Tenant-Id: 44e83cd79a56499f92e288b2c69de397 Jul 28 05:24:33.909409 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: X-Tenant-Name: admin Jul 28 05:24:33.909409 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: X-User: admin Jul 28 05:24:33.909409 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: X-User-Domain-Id: default Jul 28 05:24:33.909409 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: X-User-Domain-Name: Default Jul 28 05:24:33.909409 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: X-User-Id: 40170d20cf2e4d67929f88ba378a2373 Jul 28 05:24:33.909409 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: X-User-Name: admin Jul 28 05:24:33.909409 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: method: > Jul 28 05:24:33.909409 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: exception: Flavor 451 could not be found. Jul 28 05:24:33.909409 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: action_args: {'id': '451'} Jul 28 05:24:33.909409 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 05:24:33.909409 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:24:33.910575 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 05:24:33.910575 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 05:24:33.910575 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 05:24:33.910575 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 05:24:33.910575 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 05:24:33.910575 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 05:24:33.910575 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 05:24:33.910575 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 05:24:33.910575 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 05:24:33.910575 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:24:33.910575 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 05:24:33.910575 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 05:24:33.910575 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 28 05:24:33.910575 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Jul 28 05:24:33.910575 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:24:33.910575 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Jul 28 05:24:33.910575 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:24:33.910575 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:24:33.910575 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:24:33.911962 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 05:24:33.911962 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 05:24:33.911962 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 05:24:33.911962 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:24:33.911962 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 05:24:33.911962 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 05:24:33.911962 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 28 05:24:33.911962 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Jul 28 05:24:33.911962 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:24:33.911962 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Jul 28 05:24:33.911962 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:24:33.911962 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:24:33.911962 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:24:33.911962 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 05:24:33.911962 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 05:24:33.911962 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 28 05:24:33.911962 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Jul 28 05:24:33.911962 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-d31ef7a3-6247-406f-b43f-588c55f81c13 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 05:24:33.913221 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-d31ef7a3-6247-406f-b43f-588c55f81c13 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012370 Jul 28 05:24:33.913221 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 27/52] 10.222.0.33 () {60 vars in 1193 bytes} [Thu Jul 28 05:24:33 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 05:24:34.870016 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-54b0712a-6af1-4a60-bbf3-095474d6936e admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:24:34.871064 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-54b0712a-6af1-4a60-bbf3-095474d6936e admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Jul 28 05:24:34.871453 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 26/53] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Jul 28 05:24:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:24:35.397341 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-c2d30afd-8ff3-4a02-816f-91086630c731 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:24:35.496898 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-c2d30afd-8ff3-4a02-816f-91086630c731 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.485337 Jul 28 05:24:35.497441 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 28/54] 10.222.0.33 () {64 vars in 1235 bytes} [Thu Jul 28 05:24:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 05:24:36.461541 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-54b0712a-6af1-4a60-bbf3-095474d6936e admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:24:36.462641 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-54b0712a-6af1-4a60-bbf3-095474d6936e admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002085 Jul 28 05:24:36.463041 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 27/55] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Jul 28 05:24:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:24:36.990719 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-099e0639-4476-422f-acef-8c226c6870d7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:24:37.114374 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-099e0639-4476-422f-acef-8c226c6870d7 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.513312 Jul 28 05:24:37.114913 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 29/56] 10.222.0.33 () {64 vars in 1235 bytes} [Thu Jul 28 05:24:36 2022] POST /compute/v2.1/flavors => generated 405 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 05:24:38.093165 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-54b0712a-6af1-4a60-bbf3-095474d6936e admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:24:38.094288 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-54b0712a-6af1-4a60-bbf3-095474d6936e admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001550 Jul 28 05:24:38.094702 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 28/57] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Jul 28 05:24:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:24:38.622358 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-74f1eef8-6186-4c55-aec5-7c2dbf407718 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:24:38.673823 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-74f1eef8-6186-4c55-aec5-7c2dbf407718 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.439082 Jul 28 05:24:38.674366 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 30/58] 10.222.0.33 () {64 vars in 1235 bytes} [Thu Jul 28 05:24:38 2022] POST /compute/v2.1/flavors => generated 407 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 05:24:39.649372 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-54b0712a-6af1-4a60-bbf3-095474d6936e admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:24:39.650412 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-54b0712a-6af1-4a60-bbf3-095474d6936e admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Jul 28 05:24:39.650837 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 29/59] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Jul 28 05:24:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:24:40.174816 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-7c9e64c1-95d6-4a43-a3a9-db6d09ee2f00 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:24:40.250915 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-7c9e64c1-95d6-4a43-a3a9-db6d09ee2f00 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.461344 Jul 28 05:24:40.251492 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 31/60] 10.222.0.33 () {64 vars in 1235 bytes} [Thu Jul 28 05:24:39 2022] POST /compute/v2.1/flavors => generated 409 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 05:24:41.226459 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-54b0712a-6af1-4a60-bbf3-095474d6936e admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:24:41.227690 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-54b0712a-6af1-4a60-bbf3-095474d6936e admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002332 Jul 28 05:24:41.228091 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 30/61] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Jul 28 05:24:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:24:41.748749 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-c4b9adff-4b08-4dde-8e83-8296d4df97b9 admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:24:41.769002 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-c4b9adff-4b08-4dde-8e83-8296d4df97b9 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.405005 Jul 28 05:24:41.769550 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 32/62] 10.222.0.33 () {60 vars in 1202 bytes} [Thu Jul 28 05:24:41 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:25:33.172937 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-54b0712a-6af1-4a60-bbf3-095474d6936e admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:25:33.173979 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-54b0712a-6af1-4a60-bbf3-095474d6936e admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Jul 28 05:25:33.174378 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 31/63] 10.222.0.33 () {54 vars in 930 bytes} [Thu Jul 28 05:25:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:25:33.185147 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG dbcounter [-] [103523] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:25:33.570047 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-6b39220d-a8d1-469b-9d72-fb6e4906e886 admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:25:33.590148 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-6b39220d-a8d1-469b-9d72-fb6e4906e886 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.409451 Jul 28 05:25:33.590679 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 33/64] 10.222.0.33 () {60 vars in 1291 bytes} [Thu Jul 28 05:25:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:25:33.614835 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-f1acdf35-fab2-462b-8fee-58351ad2791c admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:25:33.618281 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG dbcounter [-] [103524] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=103524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:25:33.623172 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-f1acdf35-fab2-462b-8fee-58351ad2791c admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012691 Jul 28 05:25:33.623687 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 32/65] 10.222.0.33 () {60 vars in 1282 bytes} [Thu Jul 28 05:25:33 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:25:33.635894 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-ffe7b69d-549a-4916-bffe-d12e6091055b admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:25:33.643636 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-ffe7b69d-549a-4916-bffe-d12e6091055b admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011911 Jul 28 05:25:33.644181 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 34/66] 10.222.0.33 () {60 vars in 1285 bytes} [Thu Jul 28 05:25:33 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:25:33.657273 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-551d90f0-45cd-4a4e-af2c-58922d2ed842 admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:25:33.666310 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-551d90f0-45cd-4a4e-af2c-58922d2ed842 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013440 Jul 28 05:25:33.666855 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 33/67] 10.222.0.33 () {60 vars in 1285 bytes} [Thu Jul 28 05:25:33 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:25:33.678674 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-55f635da-f4dc-425b-ad24-a965822ae601 admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:25:33.686264 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-55f635da-f4dc-425b-ad24-a965822ae601 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011773 Jul 28 05:25:33.686783 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 35/68] 10.222.0.33 () {60 vars in 1282 bytes} [Thu Jul 28 05:25:33 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:29:26.365608 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-551d90f0-45cd-4a4e-af2c-58922d2ed842 admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:29:26.366624 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-551d90f0-45cd-4a4e-af2c-58922d2ed842 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Jul 28 05:29:26.367015 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 34/69] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Jul 28 05:29:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:29:26.508507 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG dbcounter [-] [103523] Writing DB stats nova_api:SELECT=6 {{(pid=103523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:29:26.651687 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-73e41879-176b-41ff-b32e-3f7e19bdb11d admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:29:26.654723 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 05:29:26.654723 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: warnings.warn(msg) Jul 28 05:29:26.655945 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-73e41879-176b-41ff-b32e-3f7e19bdb11d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:29:26.656660 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-73e41879-176b-41ff-b32e-3f7e19bdb11d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:29:26.657430 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-73e41879-176b-41ff-b32e-3f7e19bdb11d admin admin] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:29:26.657894 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-73e41879-176b-41ff-b32e-3f7e19bdb11d admin admin] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:29:26.691014 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-73e41879-176b-41ff-b32e-3f7e19bdb11d admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.183867 Jul 28 05:29:26.691571 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 36/70] 10.222.0.33 () {60 vars in 1193 bytes} [Thu Jul 28 05:29:26 2022] GET /compute/v2.1/os-services => generated 794 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 05:29:27.519887 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-551d90f0-45cd-4a4e-af2c-58922d2ed842 admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:29:27.520898 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-551d90f0-45cd-4a4e-af2c-58922d2ed842 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Jul 28 05:29:27.521293 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 35/71] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Jul 28 05:29:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:29:27.714889 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-449514ca-400e-4167-8117-50d41c34cd8e admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:29:27.717453 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 05:29:27.717453 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: warnings.warn(msg) Jul 28 05:29:27.718722 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-449514ca-400e-4167-8117-50d41c34cd8e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:29:27.719170 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-449514ca-400e-4167-8117-50d41c34cd8e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:29:27.719948 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-449514ca-400e-4167-8117-50d41c34cd8e admin admin] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:29:27.720375 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-449514ca-400e-4167-8117-50d41c34cd8e admin admin] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:29:27.739593 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-449514ca-400e-4167-8117-50d41c34cd8e admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.076220 Jul 28 05:29:27.740142 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 37/72] 10.222.0.33 () {60 vars in 1193 bytes} [Thu Jul 28 05:29:27 2022] GET /compute/v2.1/os-services => generated 794 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 05:29:38.974598 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-551d90f0-45cd-4a4e-af2c-58922d2ed842 admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:29:38.975661 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-551d90f0-45cd-4a4e-af2c-58922d2ed842 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jul 28 05:29:38.976079 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 36/73] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Jul 28 05:29:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:29:39.120500 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG dbcounter [-] [103523] Writing DB stats nova_cell0:SELECT=4 {{(pid=103523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:29:39.121127 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG dbcounter [-] [103523] Writing DB stats nova_cell1:SELECT=4 {{(pid=103523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:29:39.121763 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG dbcounter [-] [103523] Writing DB stats nova_api:SELECT=8 {{(pid=103523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:29:39.171303 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-afa9e351-cbd3-4c25-a677-fee6005c8301 admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:29:39.174057 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 05:29:39.174057 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: warnings.warn(msg) Jul 28 05:29:39.175647 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-afa9e351-cbd3-4c25-a677-fee6005c8301 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:29:39.176090 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-afa9e351-cbd3-4c25-a677-fee6005c8301 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:29:39.176874 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-afa9e351-cbd3-4c25-a677-fee6005c8301 admin admin] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:29:39.177301 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-afa9e351-cbd3-4c25-a677-fee6005c8301 admin admin] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:29:39.204584 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-afa9e351-cbd3-4c25-a677-fee6005c8301 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.088577 Jul 28 05:29:39.205136 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 38/74] 10.222.0.33 () {60 vars in 1193 bytes} [Thu Jul 28 05:29:39 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:29:40.035166 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-551d90f0-45cd-4a4e-af2c-58922d2ed842 admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:29:40.036171 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-551d90f0-45cd-4a4e-af2c-58922d2ed842 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Jul 28 05:29:40.036606 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 37/75] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Jul 28 05:29:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:29:40.230433 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-5ecb2c58-855a-4465-820c-4677b29266f8 admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:29:40.232829 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 05:29:40.232829 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: warnings.warn(msg) Jul 28 05:29:40.234053 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-5ecb2c58-855a-4465-820c-4677b29266f8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:29:40.234494 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-5ecb2c58-855a-4465-820c-4677b29266f8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:29:40.235272 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-5ecb2c58-855a-4465-820c-4677b29266f8 admin admin] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:29:40.235697 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-5ecb2c58-855a-4465-820c-4677b29266f8 admin admin] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:29:40.257563 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-5ecb2c58-855a-4465-820c-4677b29266f8 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.080118 Jul 28 05:29:40.258070 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 39/76] 10.222.0.33 () {60 vars in 1193 bytes} [Thu Jul 28 05:29:40 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:30:35.944574 dv-cinder-799871-48-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 28 05:30:35.946100 dv-cinder-799871-48-iscsi devstack@n-api.service[103522]: Thu Jul 28 05:30:35 2022 - graceful shutdown triggered... Jul 28 05:30:35.948240 dv-cinder-799871-48-iscsi devstack@n-api.service[103523]: Gracefully killing worker 1 (pid: 103523)... Jul 28 05:30:35.957542 dv-cinder-799871-48-iscsi devstack@n-api.service[103524]: Gracefully killing worker 2 (pid: 103524)... Jul 28 05:30:36.946129 dv-cinder-799871-48-iscsi devstack@n-api.service[103522]: worker 1 buried after 1 seconds Jul 28 05:30:36.946129 dv-cinder-799871-48-iscsi devstack@n-api.service[103522]: worker 2 buried after 1 seconds Jul 28 05:30:36.946129 dv-cinder-799871-48-iscsi devstack@n-api.service[103522]: goodbye to uWSGI. Jul 28 05:30:36.947596 dv-cinder-799871-48-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 28 05:30:36.948138 dv-cinder-799871-48-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 28 05:30:36.951026 dv-cinder-799871-48-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 28 05:30:36.964576 dv-cinder-799871-48-iscsi devstack@n-api.service[124469]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 28 05:30:36.966828 dv-cinder-799871-48-iscsi devstack@n-api.service[124469]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 28 05:30:36 2022] *** Jul 28 05:30:36.966828 dv-cinder-799871-48-iscsi devstack@n-api.service[124469]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 28 05:30:36.966828 dv-cinder-799871-48-iscsi devstack@n-api.service[124469]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 28 05:30:36.966828 dv-cinder-799871-48-iscsi devstack@n-api.service[124469]: nodename: dv-cinder-799871-48-iscsi Jul 28 05:30:36.966828 dv-cinder-799871-48-iscsi devstack@n-api.service[124469]: machine: x86_64 Jul 28 05:30:36.966828 dv-cinder-799871-48-iscsi devstack@n-api.service[124469]: clock source: unix Jul 28 05:30:36.966828 dv-cinder-799871-48-iscsi devstack@n-api.service[124469]: pcre jit disabled Jul 28 05:30:36.966828 dv-cinder-799871-48-iscsi devstack@n-api.service[124469]: detected number of CPU cores: 4 Jul 28 05:30:36.966828 dv-cinder-799871-48-iscsi devstack@n-api.service[124469]: current working directory: / Jul 28 05:30:36.966828 dv-cinder-799871-48-iscsi devstack@n-api.service[124469]: detected binary path: /usr/bin/uwsgi-core Jul 28 05:30:36.967541 dv-cinder-799871-48-iscsi devstack@n-api.service[124469]: your processes number limit is 47680 Jul 28 05:30:36.967541 dv-cinder-799871-48-iscsi devstack@n-api.service[124469]: your memory page size is 4096 bytes Jul 28 05:30:36.967541 dv-cinder-799871-48-iscsi devstack@n-api.service[124469]: detected max file descriptor number: 2048 Jul 28 05:30:36.967541 dv-cinder-799871-48-iscsi devstack@n-api.service[124469]: lock engine: pthread robust mutexes Jul 28 05:30:36.967541 dv-cinder-799871-48-iscsi devstack@n-api.service[124469]: thunder lock: enabled Jul 28 05:30:36.967541 dv-cinder-799871-48-iscsi devstack@n-api.service[124469]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 28 05:30:36.967541 dv-cinder-799871-48-iscsi devstack@n-api.service[124469]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 28 05:30:37.010597 dv-cinder-799871-48-iscsi devstack@n-api.service[124469]: Python main interpreter initialized at 0x5609c5e109c0 Jul 28 05:30:37.010871 dv-cinder-799871-48-iscsi devstack@n-api.service[124469]: python threads support enabled Jul 28 05:30:37.011048 dv-cinder-799871-48-iscsi devstack@n-api.service[124469]: your server socket listen backlog is limited to 100 connections Jul 28 05:30:37.011206 dv-cinder-799871-48-iscsi devstack@n-api.service[124469]: your mercy for graceful operations on workers is 90 seconds Jul 28 05:30:37.011684 dv-cinder-799871-48-iscsi devstack@n-api.service[124469]: mapped 403077 bytes (393 KB) for 2 cores Jul 28 05:30:37.011943 dv-cinder-799871-48-iscsi devstack@n-api.service[124469]: *** Operational MODE: preforking *** Jul 28 05:30:37.012434 dv-cinder-799871-48-iscsi devstack@n-api.service[124469]: *** uWSGI is running in multiple interpreter mode *** Jul 28 05:30:37.012621 dv-cinder-799871-48-iscsi devstack@n-api.service[124469]: spawned uWSGI master process (pid: 124469) Jul 28 05:30:37.013002 dv-cinder-799871-48-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 28 05:30:37.013702 dv-cinder-799871-48-iscsi devstack@n-api.service[124469]: spawned uWSGI worker 1 (pid: 124482, cores: 1) Jul 28 05:30:37.014202 dv-cinder-799871-48-iscsi devstack@n-api.service[124469]: spawned uWSGI worker 2 (pid: 124483, cores: 1) Jul 28 05:30:37.025969 dv-cinder-799871-48-iscsi devstack@n-api.service[124469]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 28 05:30:37.678772 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 28 05:30:37.701043 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 28 05:30:38.861550 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 05:30:38.861550 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: from cryptography.utils import int_from_bytes Jul 28 05:30:38.862149 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 05:30:38.862149 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: from cryptography.utils import int_from_bytes Jul 28 05:30:38.881072 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 05:30:38.881072 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: from cryptography.utils import int_from_bytes Jul 28 05:30:38.881828 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 05:30:38.881828 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: from cryptography.utils import int_from_bytes Jul 28 05:30:41.304175 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 05:30:41.304175 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 05:30:41.304175 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 05:30:41.304175 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 05:30:41.304175 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 05:30:41.304175 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.304175 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.304175 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.305319 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.305319 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.305319 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.305319 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.305319 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.305319 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.305319 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.305319 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.306211 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-799871-48-iscsi {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.306211 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.306211 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.306211 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.306211 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.306211 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.306211 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.306211 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.306810 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.306944 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.307435 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.308034 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.308542 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.309028 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.309512 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.310007 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.310314 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.310660 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.310982 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.311390 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-799871-48-iscsi {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.311708 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.312016 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.312331 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.312839 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.313360 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.313754 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.314088 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.314407 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.314714 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.315047 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.315363 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.315684 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.316005 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.316302 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.316613 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.316919 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.317239 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.317568 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.317873 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.318125 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.318430 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.318762 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.319085 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.319406 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.319856 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.320116 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.320443 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.320762 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.321078 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.321388 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.321724 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.322035 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.322344 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.322654 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.322964 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.323273 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.323593 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.323912 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.324237 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.324543 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.324848 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 05:30:41.325307 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.325402 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 05:30:41.325651 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.325651 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.325831 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 05:30:41.325912 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.325987 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 05:30:41.326184 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.326290 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 05:30:41.326471 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.326610 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.326779 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.327101 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.327288 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.327444 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.327589 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.327739 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.327902 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.328047 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.328206 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.328908 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.329170 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.329388 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.329604 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.330171 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.330399 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.330566 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.330720 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.330874 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.331057 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.331222 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.331374 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-799871-48-iscsi {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.331527 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.331679 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.331854 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.332000 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.332154 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.332313 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.332467 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.332619 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.332770 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.332945 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.333119 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.333272 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.333425 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.333616 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.333774 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.333927 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.334079 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.334250 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.334404 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.334557 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.334702 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.335184 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.335348 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.335501 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.335655 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.335809 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.335961 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.336115 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.336271 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.336422 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.336568 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.336712 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.336866 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.337011 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.337165 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.337316 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.337462 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.337647 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.337647 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.337941 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-799871-48-iscsi {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.338096 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.338249 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.338438 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.338596 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.338743 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.338886 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.339041 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.339210 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.339358 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.339511 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.339656 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.339807 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.339984 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.340617 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.340783 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.340939 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.341092 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.341247 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.341403 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.341591 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.341746 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.341893 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.342045 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.342204 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.342351 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.342495 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.342638 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.342782 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.342926 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.343152 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.343299 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.343454 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.343611 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.343763 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.343926 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.344825 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.345341 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.345546 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.345702 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.345858 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.346011 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.346166 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.346312 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.346491 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.346649 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.346809 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.346964 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.347111 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.347265 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.347421 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.347575 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.347720 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.347879 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.348025 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.348179 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.348331 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.348487 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.348646 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.348799 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.348950 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.348950 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.349239 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.349393 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.349648 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.349799 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.349951 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.350102 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.350263 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.350818 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.350999 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.351147 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.351306 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.351464 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.351608 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.351762 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.351907 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.352052 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.352195 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.352341 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.352492 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.352650 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.352806 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.352950 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.353104 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.353250 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.353394 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.353574 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.353729 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.353875 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.354019 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.354169 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.354314 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.354472 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.354663 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.354828 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.354974 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.355433 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.355614 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.355763 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.355906 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.356050 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.356232 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.356395 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.356551 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.356737 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.356886 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.357030 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.357186 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.357338 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.357551 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.357707 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.357853 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.358007 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.358007 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.358288 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.358442 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.358587 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.358731 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.358883 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.359044 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.359198 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.359344 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.359487 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.359693 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.359851 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.360005 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.360251 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.360459 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.360999 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.361164 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.361329 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.361499 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.361676 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.361840 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.361987 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.362139 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.362292 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.362443 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.362600 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.362746 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.362746 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.362746 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.363165 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.363318 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.363569 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.363710 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.363810 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.363900 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.363995 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.364091 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.364180 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.364277 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.364377 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.364465 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.364557 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.364638 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.364719 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.364794 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.364875 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.364957 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.365038 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.365038 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.365038 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.365038 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.365658 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.365761 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.365850 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.365925 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.365997 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.366070 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.366149 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.366234 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.366309 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.366389 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.366464 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.366683 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.366769 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.367002 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.367093 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.367314 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.367404 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.367627 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.367720 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.367960 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.368044 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.368271 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.368366 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.368919 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.369037 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.369125 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.369201 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.369281 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.369362 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.369533 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.369711 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.369806 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.369901 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.370080 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.370177 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.370401 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.370505 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.370989 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.371107 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.371197 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.371284 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.371381 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.371484 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.371663 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.371769 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.371934 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:30:41.372030 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.372248 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.372389 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.372572 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.372669 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.372888 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.372993 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.373203 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.373300 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.373563 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.373663 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.373895 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.373988 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.374202 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.374306 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.374510 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.374611 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.374824 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.374919 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.375139 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.375272 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.375581 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.375843 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.375950 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.376341 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.376465 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.376556 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.376643 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.376813 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.376915 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.377125 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.377222 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.377431 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.377631 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.377759 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.377871 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.378071 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.378177 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.378373 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.378476 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.378676 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.378783 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.378997 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.379093 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.379310 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.379404 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.379615 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.379723 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.379920 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.380016 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.380223 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.380317 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.380570 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.380679 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.381026 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.381133 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.381234 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.381329 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.381570 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.381694 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.381888 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.381994 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.382195 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.382288 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.382504 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.382609 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.382817 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.382910 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.383128 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.383230 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.383440 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.383542 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.383751 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.383857 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.384060 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.384153 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.384373 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.384468 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.384679 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.384779 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.384988 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.385081 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.385295 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.385397 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.385699 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.385825 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.385994 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.386113 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.386297 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.386413 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.386576 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.386716 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.386890 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.386996 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.387200 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.387295 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.387510 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.387613 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.387817 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.387925 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.388118 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.388220 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.388419 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.388520 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.388720 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.388863 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.389024 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.389120 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.389323 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.389418 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.389662 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.389783 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.389985 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.390087 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.390286 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.390378 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.390604 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.390711 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.394039 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.394171 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.394171 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.394345 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.394448 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.394545 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.394647 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.394743 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.394840 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.394922 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.395054 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.395143 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.395217 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.395298 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.395298 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.395445 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.395528 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.395609 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.395826 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.395927 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.396004 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.396004 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.396175 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.396259 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.396497 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.396591 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.396681 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.396766 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.396841 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.396920 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.396994 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.397074 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.397159 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.397249 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.397325 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.397397 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.397634 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.398106 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.398242 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.398406 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.398559 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.398701 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.398841 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.398979 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.399132 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.399288 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.399429 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.399590 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.399731 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.399880 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.400099 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.400250 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.400398 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.400548 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.400706 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.400802 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.400802 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.400983 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.401075 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.401284 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.401728 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.401840 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.401934 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.402011 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.402090 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.402188 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.402272 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.402489 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.402582 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.402789 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.402880 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.403090 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.403174 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.403391 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.403485 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.404055 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.404153 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.404315 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.404410 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.404568 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.404654 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.404869 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.404961 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.405168 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.405251 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.405627 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.406116 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.406259 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.406422 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.406422 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.407432 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.407591 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.407751 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.407751 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.408033 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.408173 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.408321 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.408461 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.408718 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.408887 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.409042 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.409196 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.409348 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.409569 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.409712 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.409853 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.409993 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.410134 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.410286 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.410427 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.410693 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.410846 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.410987 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.411139 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.411290 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.411431 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.411570 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.411938 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.412095 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.412247 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.412395 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.412536 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.412675 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.412825 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.412975 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.413130 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.413281 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.413281 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.413581 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.413735 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.413885 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.414041 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.414275 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.414514 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.414672 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.414813 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.414972 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.415133 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.415284 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.415425 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.415576 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.415715 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.415879 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.416149 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.416306 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.416448 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.416607 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.416824 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.416968 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.417130 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.417374 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.417510 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.417606 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.417691 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.417765 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.417845 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.417917 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.417989 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.418076 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.418158 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.418232 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.418315 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.418393 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.418596 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.418691 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.418923 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.419024 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.419228 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.419313 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.419536 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.419629 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.419853 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.419943 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.420159 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.420242 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.420460 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.420559 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.420764 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.420846 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.421063 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.421155 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.421365 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.421459 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.422664 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.422760 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.422857 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.422950 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.423032 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.423114 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.423282 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.423368 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.423594 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.423690 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.423907 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.424000 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.424216 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.424321 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.424608 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.424757 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.424837 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.424909 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.425118 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.425202 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.425437 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.425827 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.425979 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.426278 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.426442 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.426588 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.426588 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.427066 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.427234 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.427411 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.427655 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.427819 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.427978 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.428132 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.428322 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.428510 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.428667 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.428815 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.428978 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.429133 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.429294 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.429451 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.429652 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.429812 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.429968 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.430122 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.430286 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.430432 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.430584 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.430742 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.430898 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.431046 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.431205 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.431351 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.431503 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.431671 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.431825 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.431970 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.432353 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.432644 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.432807 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.433036 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.433815 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.433984 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.434143 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.434297 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.434463 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.434727 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.434994 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.435753 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.435913 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.436061 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.436340 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.436498 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.436646 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.436808 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.436963 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.437213 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.437383 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.437593 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.438615 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.438779 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.438927 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.439073 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.439073 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.439356 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.439517 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.439673 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.439673 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.439957 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.440103 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.440258 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.440429 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.440578 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.440723 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.440868 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.441028 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.441176 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.441336 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.441513 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.441669 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.441814 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.441969 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.441969 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.442614 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.442843 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.442843 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.443126 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.443280 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.443442 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.443597 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.443751 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.443904 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.444064 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.444210 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.444363 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.444509 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.444689 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.444961 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.445224 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.445384 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.445620 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.445783 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.445930 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.446085 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.446232 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.446397 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.446629 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.446789 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.446936 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.447103 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.447349 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.447502 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.447649 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.447649 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.447950 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.448109 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.448255 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.448393 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.448523 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.448765 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.448930 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.449049 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.449147 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.449236 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.449322 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.449416 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.449530 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.449624 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.449713 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.449809 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.449898 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.449992 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.450094 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.450191 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.450286 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.450374 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.450460 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.450460 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.450632 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.450721 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.450807 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.450937 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.451040 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.451142 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.451231 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.451231 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.451389 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.451474 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.451567 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.451663 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.451757 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.451852 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.451940 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.452026 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.452119 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.452219 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.452314 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.452401 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.452696 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.452799 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.452914 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.453060 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.453159 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.453247 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.453386 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.453504 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.453591 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.453688 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.453785 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.453874 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.453969 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.454063 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.454169 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.454297 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.454444 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.454541 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.454637 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.454725 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.454826 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.454931 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.455021 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.455021 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.455177 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.455280 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.455370 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.455458 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.455552 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.455654 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.455742 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.455837 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.455925 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.456011 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.456096 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.456190 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.456284 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.456380 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.456476 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.456669 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.456785 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.456939 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.457036 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.457245 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.457362 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.457572 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.457692 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.457880 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.457975 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.458190 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.458294 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.458493 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.458596 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.458798 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.458925 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.459106 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.459215 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.459405 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.459503 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.459703 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.459808 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.460009 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.460105 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.460327 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.460423 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.460638 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.460748 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.460934 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.461038 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.461239 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.461335 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.461562 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.461677 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.461863 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.461958 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.462164 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.462269 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.462469 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.462580 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.462772 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.462887 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.463062 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.463157 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.463360 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.463527 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.463686 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.463820 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.463947 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.464126 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.464267 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.464540 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.464645 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.464853 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.464949 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.465148 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.465255 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.465453 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.465560 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.465804 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.465899 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.466107 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.466205 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.466419 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.466512 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.466790 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.466893 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.467037 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.467132 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.467354 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.467449 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.467668 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.467783 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.467977 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.468080 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.468284 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.468377 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.468585 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.468678 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.468896 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.469065 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.469250 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.469363 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.469602 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.469848 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.469960 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.470157 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.470336 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.470463 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.470662 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.470895 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.471002 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.471165 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.471332 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.471477 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.471663 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.471802 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.471972 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.472165 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.472277 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.472520 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.472606 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.472890 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.473008 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.473128 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.473215 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.473437 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.473541 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.473767 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.473862 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.474074 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.474159 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.474381 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.474475 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.474691 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.474775 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.475002 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.475096 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.476499 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.476629 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.476712 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.476810 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.476919 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.477002 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.477091 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.477192 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.477289 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.477383 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.477490 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.477591 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.477708 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.477804 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.477893 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.477980 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.478074 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.478162 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.478266 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.478365 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.478467 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.478563 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.478652 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.478747 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.478958 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.479081 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.479295 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.479389 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.479607 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.479717 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.479929 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.480033 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.480264 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.480369 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.480597 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.480694 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.480900 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.481001 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.481210 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.481313 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.481587 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.481708 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.481900 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.482014 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.482218 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.482322 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.482864 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.482987 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.483077 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.483154 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.483235 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.483330 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.483414 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.483596 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.483722 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.483881 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.484023 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.484183 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.484327 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.484491 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.485180 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.485454 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.485592 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.485844 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.486010 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.486150 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.486326 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.486475 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.486641 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.486780 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.486969 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.487103 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.487276 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.487412 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.487600 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.487718 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.488020 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.488131 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.488322 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.488416 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.488625 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.488722 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.488952 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.489046 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.489283 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.489376 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.489633 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.489745 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.489956 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.490059 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.490274 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.490368 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.490581 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.490676 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.490887 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.490981 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.491197 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.491301 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.491504 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.491600 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.491816 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.491918 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.492130 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.492234 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.492438 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.492540 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.492750 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.492845 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.493067 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.493168 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.493355 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.493450 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.493696 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.493793 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.494006 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.494110 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.494318 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.494423 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.494730 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.494890 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.495056 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.495219 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.495365 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.495542 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.495686 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.495840 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.496010 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.496153 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.496314 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.496467 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.496621 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.496781 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.496928 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.497093 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.497230 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.497402 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.497583 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.497737 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.497847 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.498047 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.498143 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.498377 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.498481 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.498700 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.498797 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.499027 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.499124 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.499328 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.499422 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.499630 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.499740 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.499949 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.500044 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.500308 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.500958 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.501239 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.501344 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.501625 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.501785 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.501943 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.502114 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.502251 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.502438 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.502565 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.502744 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.502882 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.503067 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.503198 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.503375 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.503512 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.503677 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.503826 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.503982 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.504140 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.504286 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.504453 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.504628 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.504764 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.504932 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.505073 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.505252 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.505386 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.505609 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.505788 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.505940 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.506039 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.506248 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.506352 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.506583 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.506693 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.506906 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.507002 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.507219 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.507314 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.507533 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.507639 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.507854 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.508076 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.508172 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.508391 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.508496 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.508726 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.508819 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.509025 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.509127 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.509325 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.509434 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.509648 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.509747 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.509953 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.510048 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.510251 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.510356 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.510551 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.510650 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.510850 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.510946 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.511169 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.511274 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.511522 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.511636 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.511780 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.511874 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.512081 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.512184 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.512379 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.512486 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.512681 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.512778 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.512980 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.513076 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.513291 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.513388 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.513628 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.513854 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.513968 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.514209 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.514313 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.514528 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.514624 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.514858 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.514957 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.515163 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.515262 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.515484 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.515587 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.515808 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.515997 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.516124 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.516262 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.516438 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.516735 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.516841 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.517051 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.517208 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.517367 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.517488 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.517698 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.517826 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.518008 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.518136 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.518317 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.518422 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.518619 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.518723 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.518921 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.519028 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.519230 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.519324 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.519537 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.519788 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.519883 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.520116 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.520213 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.520427 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.520533 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.520736 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.520832 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.521041 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.521136 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.521343 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.521447 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.521672 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.521777 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.521978 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.522080 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.522280 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.522384 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.522584 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.522679 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.522888 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.522989 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.523199 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.523296 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.523503 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.523605 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.523816 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.523919 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.524120 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.524223 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.524430 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.524533 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.524739 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.524843 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.525051 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.525153 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.525361 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.525457 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.525707 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.525812 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.526022 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.526119 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.526388 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.526498 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.526702 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.526818 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.527014 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.527125 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.527326 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.527422 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.527637 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.527734 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.527944 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.528037 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.528256 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.528488 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.528598 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.529089 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.529186 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.529416 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.529546 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.529760 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.529862 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.530071 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.530168 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.530388 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.530489 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.530695 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.530799 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.531000 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.531095 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.531321 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.531447 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.531668 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.531836 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.531982 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.532294 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.532396 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.532608 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.532906 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.533003 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.533219 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.533313 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.533554 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.533669 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.533870 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.533974 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.534184 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.534287 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.534494 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.534608 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.534803 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.534907 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.535114 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.535217 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.535422 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.535531 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.535727 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.535824 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.536037 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.536133 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.536352 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.536458 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.536656 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.536764 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.536980 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.537086 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.537288 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.537394 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.537627 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.537735 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.537941 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.538045 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.538252 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.538355 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.538560 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.538794 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.538898 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.539143 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.539274 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.539465 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.539573 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.539789 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.539912 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.540109 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.540208 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.540423 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.540527 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.540728 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.540822 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.541048 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.541145 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.541351 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.541455 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.541688 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.541792 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.542002 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.542099 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.542312 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.542407 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.542613 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.542716 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.542914 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.543011 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.543221 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.543317 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.543525 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.543631 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.543827 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.543922 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.544134 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.544239 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.544435 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.544540 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.544759 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.544855 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.545062 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.545164 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.545363 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.545498 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.545689 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.545789 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.545999 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.546090 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.546306 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.546402 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.546608 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.546710 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.546910 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.547023 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.547731 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.547834 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.548035 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.548337 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.548433 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.548640 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.548895 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.549011 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.549101 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.549242 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.549338 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.549565 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.549680 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.549872 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.549969 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.550176 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.550273 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.550480 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.550586 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.550784 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.550880 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.551086 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.551190 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.551393 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.551498 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.551695 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.551791 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.551997 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.552102 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.552298 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.552395 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.552599 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.552694 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.552900 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.553012 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.553231 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.553328 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.553593 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.553692 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.553912 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.554219 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.554333 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.554511 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.554616 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.554829 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.554926 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.555142 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.555238 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.555465 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.555568 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.555769 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.555863 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.556075 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.556172 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.556384 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.556480 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.556708 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.556815 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.557015 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.557118 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.557321 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.557415 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.557654 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.557766 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.557961 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.558071 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.558271 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.558380 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.558575 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.558685 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.558881 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.558990 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.559188 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.559284 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.559497 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.559603 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.559804 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.559908 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.560109 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.560204 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.560416 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.560515 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.560721 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.560816 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.561024 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.561131 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.561335 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.561432 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.561668 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.561775 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.561981 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.562079 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.562286 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.562391 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.562596 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.562773 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.563448 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.563603 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.563771 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.564078 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.564183 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.564386 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.564485 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.564701 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.564801 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.565009 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.565112 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.565326 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.565423 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.565692 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.565793 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.566002 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.566106 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.566313 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.566416 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.566637 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.566740 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.566984 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.567081 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.567300 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.567407 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.567640 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.567734 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.567948 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.568053 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.568282 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.568386 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.568578 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.568685 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.568883 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.568979 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.569132 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 05:30:41.569242 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.569574 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.569838 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.570174 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.570500 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.570824 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.571129 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.571433 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.571735 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.572042 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.572357 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.572663 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.572965 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.573264 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.573590 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.573893 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.574192 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.574489 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.574787 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.575090 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.575389 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.575690 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.575989 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.576292 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.576597 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.576895 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.577197 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.577510 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.577814 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.578111 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.578440 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.578970 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.579411 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.579749 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.580067 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.580391 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.580704 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.581025 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.581334 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.581681 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.582010 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.582326 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.582635 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.582967 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.583276 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.583588 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.583899 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.584207 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.584516 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.584824 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.585149 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.585494 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.585797 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.586118 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.586458 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.586755 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.587066 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.587372 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.587699 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.588005 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.588313 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.588633 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.588924 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.589231 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.589562 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.589871 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.590177 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.590487 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.590800 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.591122 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.591443 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.591748 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.592066 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.592387 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.592731 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.593040 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.593380 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.593741 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.594171 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.594808 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.595079 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:30:41.595325 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 05:30:41.630433 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO dbcounter [None req-dfff958b-1168-4e65-be71-ae06e6103d24 None None] Registered counter for database nova_api Jul 28 05:30:41.650825 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_db.sqlalchemy.engines [None req-dfff958b-1168-4e65-be71-ae06e6103d24 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 05:30:41.658397 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writer thread running {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 05:30:41.658775 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO dbcounter [None req-c619fde6-84de-462e-85bc-0d8c9e5bf716 None None] Registered counter for database nova_api Jul 28 05:30:41.679023 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_db.sqlalchemy.engines [None req-c619fde6-84de-462e-85bc-0d8c9e5bf716 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124483) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 05:30:41.685548 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG dbcounter [-] [124483] Writer thread running {{(pid=124483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 05:30:41.714032 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.context [None req-dfff958b-1168-4e65-be71-ae06e6103d24 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2db56fa7-dc06-44d8-9adb-2fc5d306a2ac(cell1) {{(pid=124482) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 05:30:41.718137 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-dfff958b-1168-4e65-be71-ae06e6103d24 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:30:41.719875 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-dfff958b-1168-4e65-be71-ae06e6103d24 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:30:41.720852 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-dfff958b-1168-4e65-be71-ae06e6103d24 None None] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:30:41.722909 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-dfff958b-1168-4e65-be71-ae06e6103d24 None None] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:30:41.724921 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO dbcounter [None req-dfff958b-1168-4e65-be71-ae06e6103d24 None None] Registered counter for database nova_cell0 Jul 28 05:30:41.728926 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO dbcounter [None req-dfff958b-1168-4e65-be71-ae06e6103d24 None None] Registered counter for database nova_cell1 Jul 28 05:30:41.736154 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_db.sqlalchemy.engines [None req-dfff958b-1168-4e65-be71-ae06e6103d24 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 05:30:41.737909 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_db.sqlalchemy.engines [None req-dfff958b-1168-4e65-be71-ae06e6103d24 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 05:30:41.742425 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.context [None req-c619fde6-84de-462e-85bc-0d8c9e5bf716 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2db56fa7-dc06-44d8-9adb-2fc5d306a2ac(cell1) {{(pid=124483) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 05:30:41.744747 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writer thread running {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 05:30:41.745090 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writer thread running {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 05:30:41.746532 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-c619fde6-84de-462e-85bc-0d8c9e5bf716 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:30:41.748089 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-c619fde6-84de-462e-85bc-0d8c9e5bf716 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:30:41.748884 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-c619fde6-84de-462e-85bc-0d8c9e5bf716 None None] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:30:41.751818 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-c619fde6-84de-462e-85bc-0d8c9e5bf716 None None] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:30:41.753858 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO dbcounter [None req-c619fde6-84de-462e-85bc-0d8c9e5bf716 None None] Registered counter for database nova_cell0 Jul 28 05:30:41.757829 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO dbcounter [None req-c619fde6-84de-462e-85bc-0d8c9e5bf716 None None] Registered counter for database nova_cell1 Jul 28 05:30:41.765462 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_db.sqlalchemy.engines [None req-c619fde6-84de-462e-85bc-0d8c9e5bf716 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124483) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 05:30:41.767882 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_db.sqlalchemy.engines [None req-c619fde6-84de-462e-85bc-0d8c9e5bf716 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124483) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 05:30:41.774545 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG dbcounter [-] [124483] Writer thread running {{(pid=124483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 05:30:41.775797 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG dbcounter [-] [124483] Writer thread running {{(pid=124483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 05:30:41.892574 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO dbcounter [None req-dfff958b-1168-4e65-be71-ae06e6103d24 None None] Registered counter for database nova_cell0 Jul 28 05:30:41.899225 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_db.sqlalchemy.engines [None req-dfff958b-1168-4e65-be71-ae06e6103d24 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 05:30:41.903583 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writer thread running {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 05:30:41.924873 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO dbcounter [None req-c619fde6-84de-462e-85bc-0d8c9e5bf716 None None] Registered counter for database nova_cell0 Jul 28 05:30:41.934012 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_db.sqlalchemy.engines [None req-c619fde6-84de-462e-85bc-0d8c9e5bf716 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124483) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 05:30:41.939334 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG dbcounter [-] [124483] Writer thread running {{(pid=124483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 05:30:42.219286 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: WARNING keystonemiddleware.auth_token [None req-dfff958b-1168-4e65-be71-ae06e6103d24 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 05:30:42.226565 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: WARNING keystonemiddleware.auth_token [None req-dfff958b-1168-4e65-be71-ae06e6103d24 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 05:30:42.262920 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: WARNING keystonemiddleware.auth_token [None req-c619fde6-84de-462e-85bc-0d8c9e5bf716 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 05:30:42.270432 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: WARNING keystonemiddleware.auth_token [None req-c619fde6-84de-462e-85bc-0d8c9e5bf716 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 05:30:42.573341 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: WARNING keystonemiddleware.auth_token [None req-dfff958b-1168-4e65-be71-ae06e6103d24 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 05:30:42.579525 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: WARNING keystonemiddleware.auth_token [None req-dfff958b-1168-4e65-be71-ae06e6103d24 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 05:30:42.584850 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5609c5e109c0 pid: 124482 (default app) Jul 28 05:30:42.613682 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: WARNING keystonemiddleware.auth_token [None req-c619fde6-84de-462e-85bc-0d8c9e5bf716 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 05:30:42.619824 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: WARNING keystonemiddleware.auth_token [None req-c619fde6-84de-462e-85bc-0d8c9e5bf716 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 05:30:42.625712 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5609c5e109c0 pid: 124483 (default app) Jul 28 05:31:24.686726 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_api:SELECT=3 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:24.690034 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell0:SELECT=3 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:24.692225 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell1:SELECT=3 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:24.695276 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG dbcounter [-] [124483] Writing DB stats nova_api:SELECT=3 {{(pid=124483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:24.696363 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell0:SELECT=3 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:24.697271 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG dbcounter [-] [124483] Writing DB stats nova_cell0:SELECT=3 {{(pid=124483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:24.699928 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG dbcounter [-] [124483] Writing DB stats nova_cell1:SELECT=3 {{(pid=124483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:24.703641 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG dbcounter [-] [124483] Writing DB stats nova_cell0:SELECT=3 {{(pid=124483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:25.645181 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-0f1aa1cd-0530-4653-aa3a-489af37457a4 tempest-VolumesSnapshotsTestJSON-921490070 tempest-VolumesSnapshotsTestJSON-921490070-project] Action: 'create', calling method: .version_select at 0x7f25e23e6ca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-603625981"}} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:31:25.678015 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-fb7b4871-ddae-4802-8040-35475bb56d53 tempest-VolumesGetTestJSON-1652634551 tempest-VolumesGetTestJSON-1652634551-project] Action: 'create', calling method: .version_select at 0x7f25e23e8d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-676888139", "metadata": {"Type": "work"}}} {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:31:27.121736 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-0f1aa1cd-0530-4653-aa3a-489af37457a4 tempest-VolumesSnapshotsTestJSON-921490070 tempest-VolumesSnapshotsTestJSON-921490070-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 2.469958 Jul 28 05:31:27.122495 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 1/1] 10.222.0.33 () {60 vars in 1155 bytes} [Thu Jul 28 05:31:24 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 2473 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 28 05:31:27.541443 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-c92aeb63-4b65-4d95-b091-aedcc613b521 tempest-VolumesNegativeTest-554140699 tempest-VolumesNegativeTest-554140699-project] Action: 'create', calling method: .version_select at 0x7f25e223ea60>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-956787615", "metadata": {"Type": "work"}}} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:31:27.541443 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-c92aeb63-4b65-4d95-b091-aedcc613b521 tempest-VolumesNegativeTest-554140699 tempest-VolumesNegativeTest-554140699-project] Request method failure captured: Jul 28 05:31:27.541443 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 28 05:31:27.541443 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept: application/json Jul 28 05:31:27.541443 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept-Encoding: identity Jul 28 05:31:27.541443 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Connection: close Jul 28 05:31:27.541443 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Length: 121 Jul 28 05:31:27.541443 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Type: application/json Jul 28 05:31:27.541443 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Host: 10.222.0.33 Jul 28 05:31:27.541443 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Openstack-System-Scope: None Jul 28 05:31:27.541443 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: User-Agent: python-urllib3/1.26.10 Jul 28 05:31:27.541443 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Auth-Token: gAAAAABi4h8sDULkXh6dVc_BZKv1TfvE7CdccEgG84yK-tidU5PRpsRRgyg-_fEQV-rpCS_0aGMe3mdFnznR0cnvB8-DQvkcQUhiNPlHfhVeUzh6ZXTooi1yeLcukxptOmrQBwo1QVbnRxvyOuk6J2966M4hw4n4TFpW1oAz4QJUJfF7eRdGTIU Jul 28 05:31:27.541443 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Id: None Jul 28 05:31:27.541443 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Name: None Jul 28 05:31:27.541443 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Identity-Status: Confirmed Jul 28 05:31:27.541443 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Is-Admin-Project: True Jul 28 05:31:27.541443 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Id: default Jul 28 05:31:27.541443 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Name: Default Jul 28 05:31:27.541443 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Id: 3df895dfc7b342658d72bffd0f5ac40e Jul 28 05:31:27.541443 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Name: tempest-VolumesNegativeTest-554140699 Jul 28 05:31:27.541443 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Role: member,reader Jul 28 05:31:27.541443 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Roles: member,reader Jul 28 05:31:27.557145 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3df895dfc7b342658d72bffd0f5ac40e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3df895dfc7b342658d72bffd0f5ac40e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3df895dfc7b342658d72bffd0f5ac40e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3df895dfc7b342658d72bffd0f5ac40e"}]}] Jul 28 05:31:27.557145 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant: tempest-VolumesNegativeTest-554140699 Jul 28 05:31:27.557145 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Id: 3df895dfc7b342658d72bffd0f5ac40e Jul 28 05:31:27.557145 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Name: tempest-VolumesNegativeTest-554140699 Jul 28 05:31:27.557145 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User: tempest-VolumesNegativeTest-554140699-project Jul 28 05:31:27.557145 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Id: default Jul 28 05:31:27.557145 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Name: Default Jul 28 05:31:27.557145 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Id: 2b29296ad64f4c87907ffc9722f2300d Jul 28 05:31:27.557145 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Name: tempest-VolumesNegativeTest-554140699-project Jul 28 05:31:27.557145 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Jul 28 05:31:27.557145 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-956787615", "metadata": {"Type": "work"}}} Jul 28 05:31:27.557145 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: method: Jul 28 05:31:27.557145 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 28 05:31:27.559275 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-956787615', 'metadata': {'Type': 'work'}}}} Jul 28 05:31:27.559275 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 05:31:27.559275 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:31:27.559275 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 05:31:27.559275 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 05:31:27.559275 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 05:31:27.559275 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise error Jul 28 05:31:27.559275 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 28 05:31:27.559275 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:31:27.559275 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 28 05:31:27.559275 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 28 05:31:27.559275 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:31:27.559275 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 28 05:31:27.559275 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi '#$%' Jul 28 05:31:27.559275 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:31:27.559275 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:31:27.559275 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:31:27.559275 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:31:27.559275 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:31:27.559275 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:31:27.559275 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 05:31:27.559275 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 05:31:27.562018 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 05:31:27.562018 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 05:31:27.562018 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 05:31:27.562018 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:31:27.562018 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 05:31:27.562018 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 05:31:27.562018 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 05:31:27.562018 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 05:31:27.562018 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 05:31:27.562018 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 05:31:27.562018 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 28 05:31:27.562018 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:31:27.562018 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:31:27.562018 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:31:27.562018 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:31:27.562018 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:31:27.562018 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:31:27.562018 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 05:31:27.562018 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 05:31:27.567047 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 28 05:31:27.567047 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:31:27.567047 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-c92aeb63-4b65-4d95-b091-aedcc613b521 tempest-VolumesNegativeTest-554140699 tempest-VolumesNegativeTest-554140699-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 05:31:27.567047 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-c92aeb63-4b65-4d95-b091-aedcc613b521 tempest-VolumesNegativeTest-554140699 tempest-VolumesNegativeTest-554140699-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.135574 Jul 28 05:31:27.567047 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 2/2] 10.222.0.33 () {60 vars in 1156 bytes} [Thu Jul 28 05:31:27 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 152 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 05:31:27.567047 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-eb815bb9-22c2-4bb9-8546-723c81abe8d2 tempest-VolumesSnapshotsTestJSON-921490070 tempest-VolumesSnapshotsTestJSON-921490070-project] Calling method '.version_select at 0x7f25e220b4c0>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:31:27.567873 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-fb7b4871-ddae-4802-8040-35475bb56d53 tempest-VolumesGetTestJSON-1652634551 tempest-VolumesGetTestJSON-1652634551-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.685315 Jul 28 05:31:27.567873 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 1/3] 10.222.0.33 () {60 vars in 1156 bytes} [Thu Jul 28 05:31:24 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 2699 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 28 05:31:27.567873 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-4f211bc1-e0df-4eeb-9048-67f23f4021c0 tempest-VolumesNegativeTest-554140699 tempest-VolumesNegativeTest-554140699-project] Action: 'create', calling method: .version_select at 0x7f25e2243af0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1189769226", "metadata": {"Type": "work"}}} {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:31:27.567873 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-4f211bc1-e0df-4eeb-9048-67f23f4021c0 tempest-VolumesNegativeTest-554140699 tempest-VolumesNegativeTest-554140699-project] Request method failure captured: Jul 28 05:31:27.567873 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 28 05:31:27.567873 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Accept: application/json Jul 28 05:31:27.567873 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Accept-Encoding: identity Jul 28 05:31:27.567873 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Connection: close Jul 28 05:31:27.567873 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Content-Length: 120 Jul 28 05:31:27.567873 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Content-Type: application/json Jul 28 05:31:27.567873 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Host: 10.222.0.33 Jul 28 05:31:27.567873 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Openstack-System-Scope: None Jul 28 05:31:27.567873 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: User-Agent: python-urllib3/1.26.10 Jul 28 05:31:27.567873 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Auth-Token: gAAAAABi4h8sDULkXh6dVc_BZKv1TfvE7CdccEgG84yK-tidU5PRpsRRgyg-_fEQV-rpCS_0aGMe3mdFnznR0cnvB8-DQvkcQUhiNPlHfhVeUzh6ZXTooi1yeLcukxptOmrQBwo1QVbnRxvyOuk6J2966M4hw4n4TFpW1oAz4QJUJfF7eRdGTIU Jul 28 05:31:27.567873 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Domain-Id: None Jul 28 05:31:27.567873 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Domain-Name: None Jul 28 05:31:27.567873 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Identity-Status: Confirmed Jul 28 05:31:27.567873 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Is-Admin-Project: True Jul 28 05:31:27.567873 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Project-Domain-Id: default Jul 28 05:31:27.567873 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Project-Domain-Name: Default Jul 28 05:31:27.567873 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Project-Id: 3df895dfc7b342658d72bffd0f5ac40e Jul 28 05:31:27.571224 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Project-Name: tempest-VolumesNegativeTest-554140699 Jul 28 05:31:27.571224 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Role: member,reader Jul 28 05:31:27.571224 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Roles: member,reader Jul 28 05:31:27.571224 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3df895dfc7b342658d72bffd0f5ac40e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3df895dfc7b342658d72bffd0f5ac40e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3df895dfc7b342658d72bffd0f5ac40e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3df895dfc7b342658d72bffd0f5ac40e"}]}] Jul 28 05:31:27.571224 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Tenant: tempest-VolumesNegativeTest-554140699 Jul 28 05:31:27.571224 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Tenant-Id: 3df895dfc7b342658d72bffd0f5ac40e Jul 28 05:31:27.571224 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Tenant-Name: tempest-VolumesNegativeTest-554140699 Jul 28 05:31:27.571224 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-User: tempest-VolumesNegativeTest-554140699-project Jul 28 05:31:27.571224 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-User-Domain-Id: default Jul 28 05:31:27.571224 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-User-Domain-Name: Default Jul 28 05:31:27.571224 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-User-Id: 2b29296ad64f4c87907ffc9722f2300d Jul 28 05:31:27.571224 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-User-Name: tempest-VolumesNegativeTest-554140699-project Jul 28 05:31:27.571224 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Jul 28 05:31:27.571224 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1189769226", "metadata": {"Type": "work"}}} Jul 28 05:31:27.571224 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: method: Jul 28 05:31:27.572264 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 28 05:31:27.572264 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1189769226', 'metadata': {'Type': 'work'}}}} Jul 28 05:31:27.572264 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 05:31:27.572264 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:31:27.572264 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 05:31:27.572264 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 05:31:27.572264 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 05:31:27.572264 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi raise error Jul 28 05:31:27.572264 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 28 05:31:27.572264 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Jul 28 05:31:27.572264 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 28 05:31:27.572264 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 28 05:31:27.572264 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Jul 28 05:31:27.572264 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 28 05:31:27.572264 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi '0' Jul 28 05:31:27.572264 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Jul 28 05:31:27.572264 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:31:27.572264 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Jul 28 05:31:27.572264 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:31:27.572264 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:31:27.572264 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:31:27.572264 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 05:31:27.573299 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 05:31:27.573299 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 05:31:27.573299 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 05:31:27.573299 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 05:31:27.573299 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:31:27.573299 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 05:31:27.573299 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 05:31:27.573299 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 05:31:27.573299 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 05:31:27.573299 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 05:31:27.573299 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 05:31:27.573299 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 28 05:31:27.573299 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Jul 28 05:31:27.573299 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:31:27.573299 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Jul 28 05:31:27.573299 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:31:27.573299 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:31:27.573299 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:31:27.573299 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 05:31:27.573299 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 05:31:27.574597 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 28 05:31:27.574597 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Jul 28 05:31:27.574597 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-4f211bc1-e0df-4eeb-9048-67f23f4021c0 tempest-VolumesNegativeTest-554140699 tempest-VolumesNegativeTest-554140699-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 05:31:27.574954 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-eb815bb9-22c2-4bb9-8546-723c81abe8d2 tempest-VolumesSnapshotsTestJSON-921490070 tempest-VolumesSnapshotsTestJSON-921490070-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/a62871e0-19db-417c-895f-77813f7017bf" status: 200 len: 344 microversion: 2.1 time: 0.113503 Jul 28 05:31:27.574954 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 3/4] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Jul 28 05:31:27 2022] GET /compute/v2.1/os-volumes/a62871e0-19db-417c-895f-77813f7017bf => generated 344 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:31:27.574954 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-1e30a1de-626c-4074-9d2e-85f40cc58511 tempest-VolumesGetTestJSON-1652634551 tempest-VolumesGetTestJSON-1652634551-project] Calling method '.version_select at 0x7f25e2251670>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:31:27.575190 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-4f211bc1-e0df-4eeb-9048-67f23f4021c0 tempest-VolumesNegativeTest-554140699 tempest-VolumesNegativeTest-554140699-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.037079 Jul 28 05:31:27.575190 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 2/5] 10.222.0.33 () {60 vars in 1156 bytes} [Thu Jul 28 05:31:27 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 05:31:27.575190 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-5dab6651-0f75-48cc-bf27-084349396b4a tempest-VolumesNegativeTest-554140699 tempest-VolumesNegativeTest-554140699-project] Action: 'create', calling method: .version_select at 0x7f25e220b4c0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1734651775", "metadata": {"Type": "work"}}} {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:31:27.575190 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-5dab6651-0f75-48cc-bf27-084349396b4a tempest-VolumesNegativeTest-554140699 tempest-VolumesNegativeTest-554140699-project] Request method failure captured: Jul 28 05:31:27.575190 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 28 05:31:27.575190 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Accept: application/json Jul 28 05:31:27.575190 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Accept-Encoding: identity Jul 28 05:31:27.575190 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Connection: close Jul 28 05:31:27.575190 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Content-Length: 119 Jul 28 05:31:27.575190 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Content-Type: application/json Jul 28 05:31:27.575190 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Host: 10.222.0.33 Jul 28 05:31:27.575190 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Openstack-System-Scope: None Jul 28 05:31:27.575190 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: User-Agent: python-urllib3/1.26.10 Jul 28 05:31:27.575190 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Auth-Token: gAAAAABi4h8sDULkXh6dVc_BZKv1TfvE7CdccEgG84yK-tidU5PRpsRRgyg-_fEQV-rpCS_0aGMe3mdFnznR0cnvB8-DQvkcQUhiNPlHfhVeUzh6ZXTooi1yeLcukxptOmrQBwo1QVbnRxvyOuk6J2966M4hw4n4TFpW1oAz4QJUJfF7eRdGTIU Jul 28 05:31:27.575190 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Domain-Id: None Jul 28 05:31:27.575190 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Domain-Name: None Jul 28 05:31:27.575190 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Identity-Status: Confirmed Jul 28 05:31:27.575190 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Is-Admin-Project: True Jul 28 05:31:27.575190 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Project-Domain-Id: default Jul 28 05:31:27.575190 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Project-Domain-Name: Default Jul 28 05:31:27.575190 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Project-Id: 3df895dfc7b342658d72bffd0f5ac40e Jul 28 05:31:27.576912 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Project-Name: tempest-VolumesNegativeTest-554140699 Jul 28 05:31:27.576912 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Role: member,reader Jul 28 05:31:27.576912 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Roles: member,reader Jul 28 05:31:27.576912 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3df895dfc7b342658d72bffd0f5ac40e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3df895dfc7b342658d72bffd0f5ac40e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3df895dfc7b342658d72bffd0f5ac40e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3df895dfc7b342658d72bffd0f5ac40e"}]}] Jul 28 05:31:27.576912 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Tenant: tempest-VolumesNegativeTest-554140699 Jul 28 05:31:27.576912 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Tenant-Id: 3df895dfc7b342658d72bffd0f5ac40e Jul 28 05:31:27.576912 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Tenant-Name: tempest-VolumesNegativeTest-554140699 Jul 28 05:31:27.576912 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-User: tempest-VolumesNegativeTest-554140699-project Jul 28 05:31:27.576912 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-User-Domain-Id: default Jul 28 05:31:27.576912 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-User-Domain-Name: Default Jul 28 05:31:27.576912 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-User-Id: 2b29296ad64f4c87907ffc9722f2300d Jul 28 05:31:27.576912 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-User-Name: tempest-VolumesNegativeTest-554140699-project Jul 28 05:31:27.576912 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Jul 28 05:31:27.576912 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1734651775", "metadata": {"Type": "work"}}} Jul 28 05:31:27.576912 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: method: Jul 28 05:31:27.577820 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 28 05:31:27.577820 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1734651775', 'metadata': {'Type': 'work'}}}} Jul 28 05:31:27.577820 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 05:31:27.577820 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:31:27.577820 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 05:31:27.577820 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 05:31:27.577820 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 05:31:27.577820 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi raise error Jul 28 05:31:27.577820 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 28 05:31:27.577820 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Jul 28 05:31:27.577820 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 28 05:31:27.577820 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 28 05:31:27.577820 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Jul 28 05:31:27.577820 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 28 05:31:27.577820 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi '' Jul 28 05:31:27.577820 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Jul 28 05:31:27.577820 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:31:27.577820 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Jul 28 05:31:27.577820 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:31:27.577820 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:31:27.577820 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:31:27.577820 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 05:31:27.579122 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 05:31:27.579122 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 05:31:27.579122 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 05:31:27.579122 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 05:31:27.579122 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:31:27.579122 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 05:31:27.579122 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 05:31:27.579122 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 05:31:27.579122 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 05:31:27.579122 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 05:31:27.579122 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 05:31:27.579122 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 28 05:31:27.579122 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Jul 28 05:31:27.579122 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:31:27.579122 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Jul 28 05:31:27.579122 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:31:27.579122 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:31:27.579122 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:31:27.579122 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 05:31:27.579122 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 05:31:27.580213 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 28 05:31:27.580213 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Jul 28 05:31:27.580213 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-5dab6651-0f75-48cc-bf27-084349396b4a tempest-VolumesNegativeTest-554140699 tempest-VolumesNegativeTest-554140699-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 05:31:27.580213 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-5dab6651-0f75-48cc-bf27-084349396b4a tempest-VolumesNegativeTest-554140699 tempest-VolumesNegativeTest-554140699-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.031413 Jul 28 05:31:27.580213 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 3/6] 10.222.0.33 () {60 vars in 1156 bytes} [Thu Jul 28 05:31:27 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 05:31:27.580213 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-55bcdf22-db96-4ed9-aba1-4f368e042895 tempest-VolumesNegativeTest-554140699 tempest-VolumesNegativeTest-554140699-project] Calling method '.version_select at 0x7f25e2243ee0>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:31:27.580571 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-1e30a1de-626c-4074-9d2e-85f40cc58511 tempest-VolumesGetTestJSON-1652634551 tempest-VolumesGetTestJSON-1652634551-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/233de139-46b4-46ff-b71c-68255200362a" status: 200 len: 352 microversion: 2.1 time: 0.119475 Jul 28 05:31:27.580571 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 4/7] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Jul 28 05:31:27 2022] GET /compute/v2.1/os-volumes/233de139-46b4-46ff-b71c-68255200362a => generated 352 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:31:27.580700 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.wsgi [None req-55bcdf22-db96-4ed9-aba1-4f368e042895 tempest-VolumesNegativeTest-554140699 tempest-VolumesNegativeTest-554140699-project] HTTP exception thrown: Volume tempest-invalid-1863319760 could not be found. Jul 28 05:31:27.580700 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-55bcdf22-db96-4ed9-aba1-4f368e042895 tempest-VolumesNegativeTest-554140699 tempest-VolumesNegativeTest-554140699-project] Request method failure captured: Jul 28 05:31:27.580700 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1863319760 HTTP/1.1 Jul 28 05:31:27.580700 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Accept: application/json Jul 28 05:31:27.580700 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Accept-Encoding: identity Jul 28 05:31:27.580700 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Connection: close Jul 28 05:31:27.580700 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Content-Length: 0 Jul 28 05:31:27.580700 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Content-Type: application/json Jul 28 05:31:27.580700 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Host: 10.222.0.33 Jul 28 05:31:27.580700 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Openstack-System-Scope: None Jul 28 05:31:27.580700 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: User-Agent: python-urllib3/1.26.10 Jul 28 05:31:27.580700 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Auth-Token: gAAAAABi4h8sDULkXh6dVc_BZKv1TfvE7CdccEgG84yK-tidU5PRpsRRgyg-_fEQV-rpCS_0aGMe3mdFnznR0cnvB8-DQvkcQUhiNPlHfhVeUzh6ZXTooi1yeLcukxptOmrQBwo1QVbnRxvyOuk6J2966M4hw4n4TFpW1oAz4QJUJfF7eRdGTIU Jul 28 05:31:27.580700 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Domain-Id: None Jul 28 05:31:27.580700 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Domain-Name: None Jul 28 05:31:27.580700 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Identity-Status: Confirmed Jul 28 05:31:27.580700 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Is-Admin-Project: True Jul 28 05:31:27.580700 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Project-Domain-Id: default Jul 28 05:31:27.580700 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Project-Domain-Name: Default Jul 28 05:31:27.580700 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Project-Id: 3df895dfc7b342658d72bffd0f5ac40e Jul 28 05:31:27.580700 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Project-Name: tempest-VolumesNegativeTest-554140699 Jul 28 05:31:27.580700 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Role: member,reader Jul 28 05:31:27.580700 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Roles: member,reader Jul 28 05:31:27.582012 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3df895dfc7b342658d72bffd0f5ac40e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3df895dfc7b342658d72bffd0f5ac40e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3df895dfc7b342658d72bffd0f5ac40e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3df895dfc7b342658d72bffd0f5ac40e"}]}] Jul 28 05:31:27.582012 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Tenant: tempest-VolumesNegativeTest-554140699 Jul 28 05:31:27.582012 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Tenant-Id: 3df895dfc7b342658d72bffd0f5ac40e Jul 28 05:31:27.582012 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Tenant-Name: tempest-VolumesNegativeTest-554140699 Jul 28 05:31:27.582012 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-User: tempest-VolumesNegativeTest-554140699-project Jul 28 05:31:27.582012 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-User-Domain-Id: default Jul 28 05:31:27.582012 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-User-Domain-Name: Default Jul 28 05:31:27.582012 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-User-Id: 2b29296ad64f4c87907ffc9722f2300d Jul 28 05:31:27.582012 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-User-Name: tempest-VolumesNegativeTest-554140699-project Jul 28 05:31:27.582012 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: method: Jul 28 05:31:27.582012 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: exception: Volume tempest-invalid-1863319760 could not be found. Jul 28 05:31:27.582012 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: action_args: {'id': 'tempest-invalid-1863319760'} Jul 28 05:31:27.582012 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 05:31:27.582745 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:31:27.582745 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 05:31:27.582745 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 05:31:27.582745 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 05:31:27.582745 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 05:31:27.582745 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 05:31:27.582745 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 05:31:27.582745 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 05:31:27.582745 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 05:31:27.582745 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 05:31:27.582745 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 05:31:27.582745 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 05:31:27.582745 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 05:31:27.582745 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 05:31:27.582745 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 05:31:27.582745 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1863319760 could not be found. (HTTP 404) (Request-ID: req-2478df3f-fbb6-44d9-81fc-b323514b29e8) Jul 28 05:31:27.582745 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Jul 28 05:31:27.582745 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:31:27.582745 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Jul 28 05:31:27.583799 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:31:27.583799 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 28 05:31:27.583799 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 28 05:31:27.583799 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 05:31:27.583799 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 05:31:27.583799 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 05:31:27.583799 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 05:31:27.583799 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 05:31:27.583799 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 05:31:27.583799 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 05:31:27.583799 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 05:31:27.583799 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 05:31:27.583799 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 05:31:27.583799 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 05:31:27.583799 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 05:31:27.583799 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 05:31:27.583799 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 05:31:27.583799 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 05:31:27.583799 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 05:31:27.584881 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 05:31:27.584881 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 05:31:27.584881 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 05:31:27.584881 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 05:31:27.584881 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1863319760 could not be found. Jul 28 05:31:27.584881 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Jul 28 05:31:27.584881 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:31:27.584881 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Jul 28 05:31:27.584881 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:31:27.584881 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:31:27.584881 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:31:27.584881 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 05:31:27.584881 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 05:31:27.584881 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 05:31:27.584881 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 05:31:27.584881 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 05:31:27.584881 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:31:27.584881 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 28 05:31:27.584881 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 05:31:27.584881 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1863319760 could not be found. Jul 28 05:31:27.588126 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Jul 28 05:31:27.588126 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:31:27.588126 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Jul 28 05:31:27.588126 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:31:27.588126 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:31:27.588126 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:31:27.588126 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 05:31:27.588126 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 05:31:27.588126 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1863319760 could not be found. Jul 28 05:31:27.588126 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Jul 28 05:31:27.588126 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-55bcdf22-db96-4ed9-aba1-4f368e042895 tempest-VolumesNegativeTest-554140699 tempest-VolumesNegativeTest-554140699-project] Returning 404 to user: Volume tempest-invalid-1863319760 could not be found. {{(pid=124483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 05:31:27.588126 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-55bcdf22-db96-4ed9-aba1-4f368e042895 tempest-VolumesNegativeTest-554140699 tempest-VolumesNegativeTest-554140699-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1863319760" status: 404 len: 99 microversion: 2.1 time: 0.070243 Jul 28 05:31:27.588126 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 4/8] 10.222.0.33 () {58 vars in 1218 bytes} [Thu Jul 28 05:31:27 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1863319760 => generated 99 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 05:31:27.589423 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-e3976cd1-0d4a-4dc7-9c54-1e9a10b0cee1 tempest-VolumesNegativeTest-554140699 tempest-VolumesNegativeTest-554140699-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005532 Jul 28 05:31:27.589423 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 5/9] 10.222.0.33 () {58 vars in 1140 bytes} [Thu Jul 28 05:31:27 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 28 05:31:27.589707 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-50c954dd-3a83-4e62-998c-ddc0195da57b tempest-VolumesNegativeTest-554140699 tempest-VolumesNegativeTest-554140699-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.012126 Jul 28 05:31:27.589707 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 5/10] 10.222.0.33 () {58 vars in 1137 bytes} [Thu Jul 28 05:31:27 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 18 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 28 05:31:27.589907 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-c93a8841-23cf-48f2-baed-250cfd602011 tempest-VolumesNegativeTest-554140699 tempest-VolumesNegativeTest-554140699-project] Calling method '.version_select at 0x7f25e223eee0>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:31:27.623232 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.wsgi [None req-c93a8841-23cf-48f2-baed-250cfd602011 tempest-VolumesNegativeTest-554140699 tempest-VolumesNegativeTest-554140699-project] HTTP exception thrown: Volume b622f06e-96a0-4e99-8d75-860976b473c8 could not be found. Jul 28 05:31:27.629288 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-c93a8841-23cf-48f2-baed-250cfd602011 tempest-VolumesNegativeTest-554140699 tempest-VolumesNegativeTest-554140699-project] Request method failure captured: Jul 28 05:31:27.629288 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: request: DELETE /compute/v2.1/os-volumes/b622f06e-96a0-4e99-8d75-860976b473c8 HTTP/1.1 Jul 28 05:31:27.629288 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept: application/json Jul 28 05:31:27.629288 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept-Encoding: identity Jul 28 05:31:27.629288 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Connection: close Jul 28 05:31:27.629288 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Length: 0 Jul 28 05:31:27.629288 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Type: application/json Jul 28 05:31:27.629288 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Host: 10.222.0.33 Jul 28 05:31:27.629288 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Openstack-System-Scope: None Jul 28 05:31:27.629288 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: User-Agent: python-urllib3/1.26.10 Jul 28 05:31:27.629288 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Auth-Token: gAAAAABi4h8sDULkXh6dVc_BZKv1TfvE7CdccEgG84yK-tidU5PRpsRRgyg-_fEQV-rpCS_0aGMe3mdFnznR0cnvB8-DQvkcQUhiNPlHfhVeUzh6ZXTooi1yeLcukxptOmrQBwo1QVbnRxvyOuk6J2966M4hw4n4TFpW1oAz4QJUJfF7eRdGTIU Jul 28 05:31:27.629288 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Id: None Jul 28 05:31:27.629288 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Name: None Jul 28 05:31:27.629288 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Identity-Status: Confirmed Jul 28 05:31:27.629288 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Is-Admin-Project: True Jul 28 05:31:27.629288 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Id: default Jul 28 05:31:27.629288 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Name: Default Jul 28 05:31:27.629288 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Id: 3df895dfc7b342658d72bffd0f5ac40e Jul 28 05:31:27.629288 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Name: tempest-VolumesNegativeTest-554140699 Jul 28 05:31:27.629288 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Role: member,reader Jul 28 05:31:27.629288 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Roles: member,reader Jul 28 05:31:27.632419 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3df895dfc7b342658d72bffd0f5ac40e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3df895dfc7b342658d72bffd0f5ac40e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3df895dfc7b342658d72bffd0f5ac40e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3df895dfc7b342658d72bffd0f5ac40e"}]}] Jul 28 05:31:27.632419 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant: tempest-VolumesNegativeTest-554140699 Jul 28 05:31:27.632419 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Id: 3df895dfc7b342658d72bffd0f5ac40e Jul 28 05:31:27.632419 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Name: tempest-VolumesNegativeTest-554140699 Jul 28 05:31:27.632419 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User: tempest-VolumesNegativeTest-554140699-project Jul 28 05:31:27.632419 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Id: default Jul 28 05:31:27.632419 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Name: Default Jul 28 05:31:27.632419 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Id: 2b29296ad64f4c87907ffc9722f2300d Jul 28 05:31:27.632419 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Name: tempest-VolumesNegativeTest-554140699-project Jul 28 05:31:27.632419 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: method: Jul 28 05:31:27.632419 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: exception: Volume b622f06e-96a0-4e99-8d75-860976b473c8 could not be found. Jul 28 05:31:27.632419 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: action_args: {'id': 'b622f06e-96a0-4e99-8d75-860976b473c8'} Jul 28 05:31:27.632419 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 05:31:27.633039 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:31:27.633039 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 05:31:27.633039 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 05:31:27.633039 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 05:31:27.633039 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 05:31:27.633039 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 05:31:27.633039 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 05:31:27.633039 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 05:31:27.633039 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 05:31:27.633039 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 05:31:27.633039 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 05:31:27.633039 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 05:31:27.633039 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 05:31:27.633039 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 05:31:27.633039 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 05:31:27.633039 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b622f06e-96a0-4e99-8d75-860976b473c8 could not be found. (HTTP 404) (Request-ID: req-c5c12f87-4cb0-4233-9f9c-4060b3bd90f2) Jul 28 05:31:27.633039 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:31:27.633039 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:31:27.633039 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:31:27.634023 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:31:27.634023 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 28 05:31:27.634023 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 28 05:31:27.634023 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 05:31:27.634023 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 05:31:27.634023 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 05:31:27.634023 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 05:31:27.634023 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 05:31:27.634023 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 05:31:27.634023 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 05:31:27.634023 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 05:31:27.634023 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 05:31:27.634023 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 05:31:27.634023 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 05:31:27.634023 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 05:31:27.634023 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 05:31:27.634023 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 05:31:27.634023 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 05:31:27.634023 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 05:31:27.634858 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 05:31:27.634858 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 05:31:27.634858 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 05:31:27.634858 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 05:31:27.634858 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b622f06e-96a0-4e99-8d75-860976b473c8 could not be found. Jul 28 05:31:27.634858 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:31:27.634858 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:31:27.634858 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:31:27.634858 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:31:27.634858 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:31:27.634858 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:31:27.634858 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 05:31:27.634858 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 05:31:27.634858 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 05:31:27.634858 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 05:31:27.634858 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 05:31:27.634858 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:31:27.634858 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 28 05:31:27.634858 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 05:31:27.635699 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b622f06e-96a0-4e99-8d75-860976b473c8 could not be found. Jul 28 05:31:27.635699 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:31:27.635699 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:31:27.635699 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:31:27.635699 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:31:27.635699 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:31:27.635699 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:31:27.635699 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 05:31:27.635699 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 05:31:27.635699 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b622f06e-96a0-4e99-8d75-860976b473c8 could not be found. Jul 28 05:31:27.635699 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:31:27.635699 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-c93a8841-23cf-48f2-baed-250cfd602011 tempest-VolumesNegativeTest-554140699 tempest-VolumesNegativeTest-554140699-project] Returning 404 to user: Volume b622f06e-96a0-4e99-8d75-860976b473c8 could not be found. {{(pid=124482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 05:31:27.635699 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-c93a8841-23cf-48f2-baed-250cfd602011 tempest-VolumesNegativeTest-554140699 tempest-VolumesNegativeTest-554140699-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/b622f06e-96a0-4e99-8d75-860976b473c8" status: 404 len: 109 microversion: 2.1 time: 0.056189 Jul 28 05:31:27.651842 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-2b25c517-02e7-460a-a00a-bfad3c704709 tempest-VolumesNegativeTest-554140699 tempest-VolumesNegativeTest-554140699-project] Calling method '.version_select at 0x7f25e2252160>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:31:27.657340 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 6/11] 10.222.0.33 () {58 vars in 1248 bytes} [Thu Jul 28 05:31:27 2022] DELETE /compute/v2.1/os-volumes/b622f06e-96a0-4e99-8d75-860976b473c8 => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 05:31:27.716373 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.wsgi [None req-2b25c517-02e7-460a-a00a-bfad3c704709 tempest-VolumesNegativeTest-554140699 tempest-VolumesNegativeTest-554140699-project] HTTP exception thrown: Volume 0e8252e5-aa5f-4a5f-8da2-543d82c42d03 could not be found. Jul 28 05:31:27.716373 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-2b25c517-02e7-460a-a00a-bfad3c704709 tempest-VolumesNegativeTest-554140699 tempest-VolumesNegativeTest-554140699-project] Request method failure captured: Jul 28 05:31:27.716373 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: request: GET /compute/v2.1/os-volumes/0e8252e5-aa5f-4a5f-8da2-543d82c42d03 HTTP/1.1 Jul 28 05:31:27.716373 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Accept: application/json Jul 28 05:31:27.716373 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Accept-Encoding: identity Jul 28 05:31:27.716373 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Connection: close Jul 28 05:31:27.716373 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Content-Length: 0 Jul 28 05:31:27.716373 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Content-Type: application/json Jul 28 05:31:27.716373 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Host: 10.222.0.33 Jul 28 05:31:27.716373 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Openstack-System-Scope: None Jul 28 05:31:27.716373 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: User-Agent: python-urllib3/1.26.10 Jul 28 05:31:27.716373 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Auth-Token: gAAAAABi4h8sDULkXh6dVc_BZKv1TfvE7CdccEgG84yK-tidU5PRpsRRgyg-_fEQV-rpCS_0aGMe3mdFnznR0cnvB8-DQvkcQUhiNPlHfhVeUzh6ZXTooi1yeLcukxptOmrQBwo1QVbnRxvyOuk6J2966M4hw4n4TFpW1oAz4QJUJfF7eRdGTIU Jul 28 05:31:27.716373 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Domain-Id: None Jul 28 05:31:27.716373 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Domain-Name: None Jul 28 05:31:27.716373 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Identity-Status: Confirmed Jul 28 05:31:27.716373 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Is-Admin-Project: True Jul 28 05:31:27.716373 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Project-Domain-Id: default Jul 28 05:31:27.716373 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Project-Domain-Name: Default Jul 28 05:31:27.716373 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Project-Id: 3df895dfc7b342658d72bffd0f5ac40e Jul 28 05:31:27.716373 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Project-Name: tempest-VolumesNegativeTest-554140699 Jul 28 05:31:27.716373 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Role: member,reader Jul 28 05:31:27.716373 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Roles: member,reader Jul 28 05:31:27.718060 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3df895dfc7b342658d72bffd0f5ac40e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3df895dfc7b342658d72bffd0f5ac40e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3df895dfc7b342658d72bffd0f5ac40e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3df895dfc7b342658d72bffd0f5ac40e"}]}] Jul 28 05:31:27.718060 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Tenant: tempest-VolumesNegativeTest-554140699 Jul 28 05:31:27.718060 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Tenant-Id: 3df895dfc7b342658d72bffd0f5ac40e Jul 28 05:31:27.718060 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Tenant-Name: tempest-VolumesNegativeTest-554140699 Jul 28 05:31:27.718060 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-User: tempest-VolumesNegativeTest-554140699-project Jul 28 05:31:27.718060 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-User-Domain-Id: default Jul 28 05:31:27.718060 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-User-Domain-Name: Default Jul 28 05:31:27.718060 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-User-Id: 2b29296ad64f4c87907ffc9722f2300d Jul 28 05:31:27.718060 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-User-Name: tempest-VolumesNegativeTest-554140699-project Jul 28 05:31:27.718060 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: method: Jul 28 05:31:27.718060 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: exception: Volume 0e8252e5-aa5f-4a5f-8da2-543d82c42d03 could not be found. Jul 28 05:31:27.718060 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: action_args: {'id': '0e8252e5-aa5f-4a5f-8da2-543d82c42d03'} Jul 28 05:31:27.718060 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 05:31:27.718674 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:31:27.718674 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 05:31:27.718674 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 05:31:27.718674 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 05:31:27.718674 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 05:31:27.718674 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 05:31:27.718674 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 05:31:27.718674 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 05:31:27.718674 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 05:31:27.718674 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 05:31:27.718674 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 05:31:27.718674 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 05:31:27.718674 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 05:31:27.718674 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 05:31:27.718674 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 05:31:27.718674 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0e8252e5-aa5f-4a5f-8da2-543d82c42d03 could not be found. (HTTP 404) (Request-ID: req-881f4495-3d3f-4493-b963-37e937354abc) Jul 28 05:31:27.718674 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Jul 28 05:31:27.718674 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:31:27.718674 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Jul 28 05:31:27.719536 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:31:27.719536 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 28 05:31:27.719536 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 28 05:31:27.719536 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 05:31:27.719536 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 05:31:27.719536 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 05:31:27.719536 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 05:31:27.719536 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 05:31:27.719536 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 05:31:27.719536 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 05:31:27.719536 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 05:31:27.719536 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 05:31:27.719536 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 05:31:27.719536 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 05:31:27.719536 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 05:31:27.719536 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 05:31:27.719536 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 05:31:27.719536 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 05:31:27.719536 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 05:31:27.720378 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 05:31:27.720378 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 05:31:27.720378 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 05:31:27.720378 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 05:31:27.720378 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0e8252e5-aa5f-4a5f-8da2-543d82c42d03 could not be found. Jul 28 05:31:27.720378 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Jul 28 05:31:27.720378 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:31:27.720378 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Jul 28 05:31:27.720378 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:31:27.720378 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:31:27.720378 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:31:27.720378 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 05:31:27.720378 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 05:31:27.720378 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 05:31:27.720378 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 05:31:27.720378 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 05:31:27.720378 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:31:27.720378 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 28 05:31:27.720378 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 05:31:27.721315 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0e8252e5-aa5f-4a5f-8da2-543d82c42d03 could not be found. Jul 28 05:31:27.721315 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Jul 28 05:31:27.721315 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:31:27.721315 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Jul 28 05:31:27.721315 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:31:27.721315 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:31:27.721315 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:31:27.721315 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 05:31:27.721315 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 05:31:27.721315 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0e8252e5-aa5f-4a5f-8da2-543d82c42d03 could not be found. Jul 28 05:31:27.721315 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Jul 28 05:31:27.721315 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-2b25c517-02e7-460a-a00a-bfad3c704709 tempest-VolumesNegativeTest-554140699 tempest-VolumesNegativeTest-554140699-project] Returning 404 to user: Volume 0e8252e5-aa5f-4a5f-8da2-543d82c42d03 could not be found. {{(pid=124483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 05:31:27.721315 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-2b25c517-02e7-460a-a00a-bfad3c704709 tempest-VolumesNegativeTest-554140699 tempest-VolumesNegativeTest-554140699-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/0e8252e5-aa5f-4a5f-8da2-543d82c42d03" status: 404 len: 109 microversion: 2.1 time: 0.066982 Jul 28 05:31:27.721315 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 6/12] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Jul 28 05:31:27 2022] GET /compute/v2.1/os-volumes/0e8252e5-aa5f-4a5f-8da2-543d82c42d03 => generated 109 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 05:31:28.411370 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-b9566ff1-af1b-4234-a790-3431704ff303 tempest-VolumesSnapshotsTestJSON-921490070 tempest-VolumesSnapshotsTestJSON-921490070-project] Calling method '.version_select at 0x7f25e220b1f0>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:31:28.504038 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-b9566ff1-af1b-4234-a790-3431704ff303 tempest-VolumesSnapshotsTestJSON-921490070 tempest-VolumesSnapshotsTestJSON-921490070-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/a62871e0-19db-417c-895f-77813f7017bf" status: 200 len: 344 microversion: 2.1 time: 0.096895 Jul 28 05:31:28.505561 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 7/13] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Jul 28 05:31:28 2022] GET /compute/v2.1/os-volumes/a62871e0-19db-417c-895f-77813f7017bf => generated 344 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:31:28.533633 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-923d950e-79d6-40f0-b957-cc49eb924102 tempest-VolumesGetTestJSON-1652634551 tempest-VolumesGetTestJSON-1652634551-project] Calling method '.version_select at 0x7f25e220b4c0>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:31:28.620415 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-923d950e-79d6-40f0-b957-cc49eb924102 tempest-VolumesGetTestJSON-1652634551 tempest-VolumesGetTestJSON-1652634551-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/233de139-46b4-46ff-b71c-68255200362a" status: 200 len: 352 microversion: 2.1 time: 0.093451 Jul 28 05:31:28.621016 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 7/14] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Jul 28 05:31:28 2022] GET /compute/v2.1/os-volumes/233de139-46b4-46ff-b71c-68255200362a => generated 352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:31:29.519249 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-def941b9-bb73-4ccf-af33-42d64d08bc57 tempest-VolumesSnapshotsTestJSON-921490070 tempest-VolumesSnapshotsTestJSON-921490070-project] Calling method '.version_select at 0x7f25e220bee0>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:31:29.578371 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-def941b9-bb73-4ccf-af33-42d64d08bc57 tempest-VolumesSnapshotsTestJSON-921490070 tempest-VolumesSnapshotsTestJSON-921490070-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/a62871e0-19db-417c-895f-77813f7017bf" status: 200 len: 345 microversion: 2.1 time: 0.062835 Jul 28 05:31:29.579138 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 8/15] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Jul 28 05:31:29 2022] GET /compute/v2.1/os-volumes/a62871e0-19db-417c-895f-77813f7017bf => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:31:29.592200 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-12d7db15-465d-4af0-9543-a4a9ebd481a2 tempest-VolumesSnapshotsTestJSON-921490070 tempest-VolumesSnapshotsTestJSON-921490070-project] Action: 'create', calling method: .version_select at 0x7f25e22528b0>, body: {"snapshot": {"volume_id": "a62871e0-19db-417c-895f-77813f7017bf", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1834222068"}} {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:31:29.638137 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-caf2126f-56dd-4d1a-81dc-507d191d0d88 tempest-VolumesGetTestJSON-1652634551 tempest-VolumesGetTestJSON-1652634551-project] Calling method '.version_select at 0x7f25e21e0670>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:31:29.703444 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-caf2126f-56dd-4d1a-81dc-507d191d0d88 tempest-VolumesGetTestJSON-1652634551 tempest-VolumesGetTestJSON-1652634551-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/233de139-46b4-46ff-b71c-68255200362a" status: 200 len: 353 microversion: 2.1 time: 0.072389 Jul 28 05:31:29.704984 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 9/16] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Jul 28 05:31:29 2022] GET /compute/v2.1/os-volumes/233de139-46b4-46ff-b71c-68255200362a => generated 353 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 05:31:29.716383 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-1461ab87-f1f8-495c-b66e-19a782285607 tempest-VolumesGetTestJSON-1652634551 tempest-VolumesGetTestJSON-1652634551-project] Calling method '.version_select at 0x7f25e220bca0>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:31:29.774286 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-1461ab87-f1f8-495c-b66e-19a782285607 tempest-VolumesGetTestJSON-1652634551 tempest-VolumesGetTestJSON-1652634551-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/233de139-46b4-46ff-b71c-68255200362a" status: 200 len: 353 microversion: 2.1 time: 0.061459 Jul 28 05:31:29.787299 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 10/17] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Jul 28 05:31:29 2022] GET /compute/v2.1/os-volumes/233de139-46b4-46ff-b71c-68255200362a => generated 353 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:31:29.802550 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-a65a10fe-30c5-494f-929c-95703f3b1693 tempest-VolumesGetTestJSON-1652634551 tempest-VolumesGetTestJSON-1652634551-project] Calling method '.version_select at 0x7f25e220b670>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:31:30.114206 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-a65a10fe-30c5-494f-929c-95703f3b1693 tempest-VolumesGetTestJSON-1652634551 tempest-VolumesGetTestJSON-1652634551-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/233de139-46b4-46ff-b71c-68255200362a" status: 202 len: 0 microversion: 2.1 time: 0.318849 Jul 28 05:31:30.114535 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 11/18] 10.222.0.33 () {58 vars in 1248 bytes} [Thu Jul 28 05:31:29 2022] DELETE /compute/v2.1/os-volumes/233de139-46b4-46ff-b71c-68255200362a => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 05:31:30.125641 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-4164c28c-03e6-470c-86ad-10528bf1a9b9 tempest-VolumesGetTestJSON-1652634551 tempest-VolumesGetTestJSON-1652634551-project] Calling method '.version_select at 0x7f25e21e04c0>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:31:30.235855 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-4164c28c-03e6-470c-86ad-10528bf1a9b9 tempest-VolumesGetTestJSON-1652634551 tempest-VolumesGetTestJSON-1652634551-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/233de139-46b4-46ff-b71c-68255200362a" status: 200 len: 352 microversion: 2.1 time: 0.116096 Jul 28 05:31:30.237269 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 12/19] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Jul 28 05:31:30 2022] GET /compute/v2.1/os-volumes/233de139-46b4-46ff-b71c-68255200362a => generated 352 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:31:30.320203 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-12d7db15-465d-4af0-9543-a4a9ebd481a2 tempest-VolumesSnapshotsTestJSON-921490070 tempest-VolumesSnapshotsTestJSON-921490070-project] 10.222.0.33 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.732458 Jul 28 05:31:30.328426 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 8/20] 10.222.0.33 () {60 vars in 1162 bytes} [Thu Jul 28 05:31:29 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:31:30.333676 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-0841b3bd-7150-499d-84b2-3262647247cd tempest-VolumesSnapshotsTestJSON-921490070 tempest-VolumesSnapshotsTestJSON-921490070-project] Calling method '.version_select at 0x7f25e220b1f0>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:31:30.684971 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-0841b3bd-7150-499d-84b2-3262647247cd tempest-VolumesSnapshotsTestJSON-921490070 tempest-VolumesSnapshotsTestJSON-921490070-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/4939b0d6-db88-44e9-8ce9-280576ec8a05" status: 200 len: 287 microversion: 2.1 time: 0.356344 Jul 28 05:31:30.686028 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 13/21] 10.222.0.33 () {58 vars in 1251 bytes} [Thu Jul 28 05:31:30 2022] GET /compute/v2.1/os-snapshots/4939b0d6-db88-44e9-8ce9-280576ec8a05 => generated 287 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 05:31:30.697576 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-df31e880-aa17-4e83-8f8f-9c03b4d7e645 tempest-VolumesSnapshotsTestJSON-921490070 tempest-VolumesSnapshotsTestJSON-921490070-project] Calling method '.version_select at 0x7f25e220b550>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:31:30.798956 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-df31e880-aa17-4e83-8f8f-9c03b4d7e645 tempest-VolumesSnapshotsTestJSON-921490070 tempest-VolumesSnapshotsTestJSON-921490070-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.106127 Jul 28 05:31:30.804079 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 9/22] 10.222.0.33 () {58 vars in 1140 bytes} [Thu Jul 28 05:31:30 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:31:30.812865 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-91addb07-aafd-44ce-89e4-faa658ab0efd tempest-VolumesSnapshotsTestJSON-921490070 tempest-VolumesSnapshotsTestJSON-921490070-project] Calling method '.version_select at 0x7f25e220be50>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:31:30.861435 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-91addb07-aafd-44ce-89e4-faa658ab0efd tempest-VolumesSnapshotsTestJSON-921490070 tempest-VolumesSnapshotsTestJSON-921490070-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/4939b0d6-db88-44e9-8ce9-280576ec8a05" status: 200 len: 287 microversion: 2.1 time: 0.045498 Jul 28 05:31:30.873308 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 14/23] 10.222.0.33 () {58 vars in 1251 bytes} [Thu Jul 28 05:31:30 2022] GET /compute/v2.1/os-snapshots/4939b0d6-db88-44e9-8ce9-280576ec8a05 => generated 287 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:31:31.252769 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-0bc34110-99ae-4e15-b7c1-36ed017e119f tempest-VolumesGetTestJSON-1652634551 tempest-VolumesGetTestJSON-1652634551-project] Calling method '.version_select at 0x7f25e220f5e0>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:31:31.323245 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.wsgi [None req-0bc34110-99ae-4e15-b7c1-36ed017e119f tempest-VolumesGetTestJSON-1652634551 tempest-VolumesGetTestJSON-1652634551-project] HTTP exception thrown: Volume 233de139-46b4-46ff-b71c-68255200362a could not be found. Jul 28 05:31:31.327120 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-0bc34110-99ae-4e15-b7c1-36ed017e119f tempest-VolumesGetTestJSON-1652634551 tempest-VolumesGetTestJSON-1652634551-project] Request method failure captured: Jul 28 05:31:31.327120 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: request: GET /compute/v2.1/os-volumes/233de139-46b4-46ff-b71c-68255200362a HTTP/1.1 Jul 28 05:31:31.327120 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Accept: application/json Jul 28 05:31:31.327120 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Accept-Encoding: identity Jul 28 05:31:31.327120 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Connection: close Jul 28 05:31:31.327120 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Content-Length: 0 Jul 28 05:31:31.327120 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Content-Type: application/json Jul 28 05:31:31.327120 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Host: 10.222.0.33 Jul 28 05:31:31.327120 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Openstack-System-Scope: None Jul 28 05:31:31.327120 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: User-Agent: python-urllib3/1.26.10 Jul 28 05:31:31.327120 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Auth-Token: gAAAAABi4h8sy7NV44fBS0CghaQ1IXl2QeoZoNhaqIEDxzsuoQfd558s_B1ocncSludBuqkKCXmX6UlblV7lhSjXRqoT2SQk_I5FrXLTFJKPpbl1ueCcqzEV57yJ06M9THmNlskHVPqS9X26LeVjvrvvAIsFm-XBTON1wbZul97c-UvpbMtVUz0 Jul 28 05:31:31.327120 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Domain-Id: None Jul 28 05:31:31.327120 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Domain-Name: None Jul 28 05:31:31.327120 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Identity-Status: Confirmed Jul 28 05:31:31.327120 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Is-Admin-Project: True Jul 28 05:31:31.327120 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Project-Domain-Id: default Jul 28 05:31:31.327120 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Project-Domain-Name: Default Jul 28 05:31:31.327120 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Project-Id: 19eae28e6e994365b586085a55f29aeb Jul 28 05:31:31.327120 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Project-Name: tempest-VolumesGetTestJSON-1652634551 Jul 28 05:31:31.327120 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Role: member,reader Jul 28 05:31:31.327120 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Roles: member,reader Jul 28 05:31:31.328475 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/19eae28e6e994365b586085a55f29aeb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/19eae28e6e994365b586085a55f29aeb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_19eae28e6e994365b586085a55f29aeb", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/19eae28e6e994365b586085a55f29aeb"}]}] Jul 28 05:31:31.328475 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Tenant: tempest-VolumesGetTestJSON-1652634551 Jul 28 05:31:31.328475 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Tenant-Id: 19eae28e6e994365b586085a55f29aeb Jul 28 05:31:31.328475 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Tenant-Name: tempest-VolumesGetTestJSON-1652634551 Jul 28 05:31:31.328475 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-User: tempest-VolumesGetTestJSON-1652634551-project Jul 28 05:31:31.328475 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-User-Domain-Id: default Jul 28 05:31:31.328475 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-User-Domain-Name: Default Jul 28 05:31:31.328475 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-User-Id: c93ac044c94544bd97d8dc7484a60f2e Jul 28 05:31:31.328475 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-User-Name: tempest-VolumesGetTestJSON-1652634551-project Jul 28 05:31:31.328475 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: method: Jul 28 05:31:31.328475 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: exception: Volume 233de139-46b4-46ff-b71c-68255200362a could not be found. Jul 28 05:31:31.328475 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: action_args: {'id': '233de139-46b4-46ff-b71c-68255200362a'} Jul 28 05:31:31.328475 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 05:31:31.329161 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:31:31.329161 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 05:31:31.329161 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 05:31:31.329161 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 05:31:31.329161 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 05:31:31.329161 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 05:31:31.329161 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 05:31:31.329161 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 05:31:31.329161 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 05:31:31.329161 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 05:31:31.329161 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 05:31:31.329161 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 05:31:31.329161 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 05:31:31.329161 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 05:31:31.329161 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 05:31:31.329161 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 233de139-46b4-46ff-b71c-68255200362a could not be found. (HTTP 404) (Request-ID: req-95d06b0c-eda9-4dd8-bec9-8cba972c95f7) Jul 28 05:31:31.329161 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Jul 28 05:31:31.329161 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:31:31.329161 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Jul 28 05:31:31.330503 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:31:31.330503 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 28 05:31:31.330503 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 28 05:31:31.330503 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 05:31:31.330503 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 05:31:31.330503 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 05:31:31.330503 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 05:31:31.330503 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 05:31:31.330503 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 05:31:31.330503 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 05:31:31.330503 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 05:31:31.330503 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 05:31:31.330503 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 05:31:31.330503 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 05:31:31.330503 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 05:31:31.330503 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 05:31:31.330503 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 05:31:31.330503 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 05:31:31.330503 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 05:31:31.331488 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 05:31:31.331488 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 05:31:31.331488 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 05:31:31.331488 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 05:31:31.331488 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 233de139-46b4-46ff-b71c-68255200362a could not be found. Jul 28 05:31:31.331488 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Jul 28 05:31:31.331488 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:31:31.331488 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Jul 28 05:31:31.331488 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:31:31.331488 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:31:31.331488 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:31:31.331488 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 05:31:31.331488 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 05:31:31.331488 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 05:31:31.331488 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 05:31:31.331488 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 05:31:31.331488 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:31:31.331488 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 28 05:31:31.331488 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 05:31:31.332395 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 233de139-46b4-46ff-b71c-68255200362a could not be found. Jul 28 05:31:31.332395 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Jul 28 05:31:31.332395 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:31:31.332395 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Jul 28 05:31:31.332395 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:31:31.332395 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:31:31.332395 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:31:31.332395 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 05:31:31.332395 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 05:31:31.332395 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 233de139-46b4-46ff-b71c-68255200362a could not be found. Jul 28 05:31:31.332395 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Jul 28 05:31:31.334704 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-0bc34110-99ae-4e15-b7c1-36ed017e119f tempest-VolumesGetTestJSON-1652634551 tempest-VolumesGetTestJSON-1652634551-project] Returning 404 to user: Volume 233de139-46b4-46ff-b71c-68255200362a could not be found. {{(pid=124483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 05:31:31.335763 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-0bc34110-99ae-4e15-b7c1-36ed017e119f tempest-VolumesGetTestJSON-1652634551 tempest-VolumesGetTestJSON-1652634551-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/233de139-46b4-46ff-b71c-68255200362a" status: 404 len: 109 microversion: 2.1 time: 0.088814 Jul 28 05:31:31.340262 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 10/24] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Jul 28 05:31:31 2022] GET /compute/v2.1/os-volumes/233de139-46b4-46ff-b71c-68255200362a => generated 109 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 05:31:31.885247 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-ddfbb2d8-6241-4ac6-b6c2-d910d463584b tempest-VolumesSnapshotsTestJSON-921490070 tempest-VolumesSnapshotsTestJSON-921490070-project] Calling method '.version_select at 0x7f25e21e0430>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:31:31.943113 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-ddfbb2d8-6241-4ac6-b6c2-d910d463584b tempest-VolumesSnapshotsTestJSON-921490070 tempest-VolumesSnapshotsTestJSON-921490070-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/4939b0d6-db88-44e9-8ce9-280576ec8a05" status: 200 len: 287 microversion: 2.1 time: 0.060089 Jul 28 05:31:31.954245 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 15/25] 10.222.0.33 () {58 vars in 1251 bytes} [Thu Jul 28 05:31:31 2022] GET /compute/v2.1/os-snapshots/4939b0d6-db88-44e9-8ce9-280576ec8a05 => generated 287 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:31:32.959259 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-d2e01ffc-7f79-475d-85ac-7abe5d0abcce tempest-VolumesSnapshotsTestJSON-921490070 tempest-VolumesSnapshotsTestJSON-921490070-project] Calling method '.version_select at 0x7f25e23e8d30>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:31:33.035583 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-d2e01ffc-7f79-475d-85ac-7abe5d0abcce tempest-VolumesSnapshotsTestJSON-921490070 tempest-VolumesSnapshotsTestJSON-921490070-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/4939b0d6-db88-44e9-8ce9-280576ec8a05" status: 200 len: 287 microversion: 2.1 time: 0.082699 Jul 28 05:31:33.036647 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 11/26] 10.222.0.33 () {58 vars in 1251 bytes} [Thu Jul 28 05:31:32 2022] GET /compute/v2.1/os-snapshots/4939b0d6-db88-44e9-8ce9-280576ec8a05 => generated 287 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:31:34.050266 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-502d2717-471c-4609-b3c9-ff419be3d165 tempest-VolumesSnapshotsTestJSON-921490070 tempest-VolumesSnapshotsTestJSON-921490070-project] Calling method '.version_select at 0x7f25e220bdc0>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:31:34.156082 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-502d2717-471c-4609-b3c9-ff419be3d165 tempest-VolumesSnapshotsTestJSON-921490070 tempest-VolumesSnapshotsTestJSON-921490070-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/4939b0d6-db88-44e9-8ce9-280576ec8a05" status: 200 len: 288 microversion: 2.1 time: 0.108538 Jul 28 05:31:34.156082 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 16/27] 10.222.0.33 () {58 vars in 1251 bytes} [Thu Jul 28 05:31:34 2022] GET /compute/v2.1/os-snapshots/4939b0d6-db88-44e9-8ce9-280576ec8a05 => generated 288 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:31:34.184629 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-5427201c-896e-415b-9033-7efe2523c1e4 tempest-VolumesSnapshotsTestJSON-921490070 tempest-VolumesSnapshotsTestJSON-921490070-project] Calling method '.version_select at 0x7f25e220b790>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:31:34.449594 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-5427201c-896e-415b-9033-7efe2523c1e4 tempest-VolumesSnapshotsTestJSON-921490070 tempest-VolumesSnapshotsTestJSON-921490070-project] 10.222.0.33 "DELETE /compute/v2.1/os-snapshots/4939b0d6-db88-44e9-8ce9-280576ec8a05" status: 202 len: 0 microversion: 2.1 time: 0.287708 Jul 28 05:31:34.459161 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-40065a4e-0e5e-4cd0-ad6a-363d30d258a4 tempest-VolumesSnapshotsTestJSON-921490070 tempest-VolumesSnapshotsTestJSON-921490070-project] Calling method '.version_select at 0x7f25e220b550>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:31:34.463415 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 12/28] 10.222.0.33 () {58 vars in 1254 bytes} [Thu Jul 28 05:31:34 2022] DELETE /compute/v2.1/os-snapshots/4939b0d6-db88-44e9-8ce9-280576ec8a05 => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 05:31:34.727516 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-40065a4e-0e5e-4cd0-ad6a-363d30d258a4 tempest-VolumesSnapshotsTestJSON-921490070 tempest-VolumesSnapshotsTestJSON-921490070-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/4939b0d6-db88-44e9-8ce9-280576ec8a05" status: 200 len: 287 microversion: 2.1 time: 0.272370 Jul 28 05:31:34.728588 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 17/29] 10.222.0.33 () {58 vars in 1251 bytes} [Thu Jul 28 05:31:34 2022] GET /compute/v2.1/os-snapshots/4939b0d6-db88-44e9-8ce9-280576ec8a05 => generated 287 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:31:35.740028 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-f86ca424-2fbc-414d-9021-feb2ab43842d tempest-VolumesSnapshotsTestJSON-921490070 tempest-VolumesSnapshotsTestJSON-921490070-project] Calling method '.version_select at 0x7f25e2bc7040>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:31:35.792686 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.wsgi [None req-f86ca424-2fbc-414d-9021-feb2ab43842d tempest-VolumesSnapshotsTestJSON-921490070 tempest-VolumesSnapshotsTestJSON-921490070-project] HTTP exception thrown: Snapshot 4939b0d6-db88-44e9-8ce9-280576ec8a05 could not be found. Jul 28 05:31:35.796144 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-f86ca424-2fbc-414d-9021-feb2ab43842d tempest-VolumesSnapshotsTestJSON-921490070 tempest-VolumesSnapshotsTestJSON-921490070-project] Request method failure captured: Jul 28 05:31:35.796144 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: request: GET /compute/v2.1/os-snapshots/4939b0d6-db88-44e9-8ce9-280576ec8a05 HTTP/1.1 Jul 28 05:31:35.796144 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Accept: application/json Jul 28 05:31:35.796144 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Accept-Encoding: identity Jul 28 05:31:35.796144 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Connection: close Jul 28 05:31:35.796144 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Content-Length: 0 Jul 28 05:31:35.796144 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Content-Type: application/json Jul 28 05:31:35.796144 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Host: 10.222.0.33 Jul 28 05:31:35.796144 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Openstack-System-Scope: None Jul 28 05:31:35.796144 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: User-Agent: python-urllib3/1.26.10 Jul 28 05:31:35.796144 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Auth-Token: gAAAAABi4h8shCvhGcWpspWqH0JcslnROqE2nvrrKUPy7jbGxu-UJJvdwru7pqAgeb_y9MLeYc6cHDL0ID0lrPpYMFnlHZ4-BRMId6F8VKlXTWMk3DJfrQaKBJJ_xdLWAbKy_BOhGk2rFJDoUmBCQibl8sf4QOxvvG8TWeH793unFOzX9woh2xY Jul 28 05:31:35.796144 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Domain-Id: None Jul 28 05:31:35.796144 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Domain-Name: None Jul 28 05:31:35.796144 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Identity-Status: Confirmed Jul 28 05:31:35.796144 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Is-Admin-Project: True Jul 28 05:31:35.796144 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Project-Domain-Id: default Jul 28 05:31:35.796144 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Project-Domain-Name: Default Jul 28 05:31:35.796144 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Project-Id: fe6ba5ebeed545748c37785b9cd087fe Jul 28 05:31:35.796144 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-921490070 Jul 28 05:31:35.796144 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Role: member,reader Jul 28 05:31:35.796144 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Roles: member,reader Jul 28 05:31:35.797296 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fe6ba5ebeed545748c37785b9cd087fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe6ba5ebeed545748c37785b9cd087fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fe6ba5ebeed545748c37785b9cd087fe", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe6ba5ebeed545748c37785b9cd087fe"}]}] Jul 28 05:31:35.797296 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Tenant: tempest-VolumesSnapshotsTestJSON-921490070 Jul 28 05:31:35.797296 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Tenant-Id: fe6ba5ebeed545748c37785b9cd087fe Jul 28 05:31:35.797296 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-921490070 Jul 28 05:31:35.797296 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-User: tempest-VolumesSnapshotsTestJSON-921490070-project Jul 28 05:31:35.797296 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-User-Domain-Id: default Jul 28 05:31:35.797296 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-User-Domain-Name: Default Jul 28 05:31:35.797296 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-User-Id: 2008109b89af4620b2de74464b4c9758 Jul 28 05:31:35.797296 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-User-Name: tempest-VolumesSnapshotsTestJSON-921490070-project Jul 28 05:31:35.797296 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: method: Jul 28 05:31:35.797296 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: exception: Snapshot 4939b0d6-db88-44e9-8ce9-280576ec8a05 could not be found. Jul 28 05:31:35.797296 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: action_args: {'id': '4939b0d6-db88-44e9-8ce9-280576ec8a05'} Jul 28 05:31:35.797296 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 05:31:35.798042 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:31:35.798042 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 28 05:31:35.798042 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 28 05:31:35.798042 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 28 05:31:35.798042 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 28 05:31:35.798042 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 28 05:31:35.798042 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 28 05:31:35.798042 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 05:31:35.798042 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 05:31:35.798042 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 05:31:35.798042 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 05:31:35.798042 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 05:31:35.798042 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 05:31:35.798042 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 05:31:35.798042 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 05:31:35.798042 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 4939b0d6-db88-44e9-8ce9-280576ec8a05 could not be found. (HTTP 404) (Request-ID: req-c9aad44c-2c47-4dd2-ba36-6f7133cdb7b2) Jul 28 05:31:35.798042 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Jul 28 05:31:35.798042 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:31:35.799016 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Jul 28 05:31:35.799016 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:31:35.799016 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 28 05:31:35.799016 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 28 05:31:35.799016 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 05:31:35.799016 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 05:31:35.799016 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 28 05:31:35.799016 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 28 05:31:35.799016 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 05:31:35.799016 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 05:31:35.799016 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 28 05:31:35.799016 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 28 05:31:35.799016 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 28 05:31:35.799016 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 28 05:31:35.799016 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 28 05:31:35.799016 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 28 05:31:35.799016 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 05:31:35.799016 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 05:31:35.799016 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 05:31:35.799922 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 05:31:35.799922 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 05:31:35.799922 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 05:31:35.799922 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 05:31:35.799922 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 05:31:35.799922 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 4939b0d6-db88-44e9-8ce9-280576ec8a05 could not be found. Jul 28 05:31:35.799922 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Jul 28 05:31:35.799922 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:31:35.799922 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Jul 28 05:31:35.799922 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:31:35.799922 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:31:35.799922 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:31:35.799922 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 05:31:35.799922 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 05:31:35.799922 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 05:31:35.799922 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 05:31:35.799922 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 05:31:35.799922 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:31:35.799922 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 28 05:31:35.799922 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 05:31:35.800942 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 4939b0d6-db88-44e9-8ce9-280576ec8a05 could not be found. Jul 28 05:31:35.800942 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Jul 28 05:31:35.800942 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:31:35.800942 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Jul 28 05:31:35.800942 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:31:35.800942 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:31:35.800942 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:31:35.800942 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 05:31:35.800942 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 05:31:35.800942 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 4939b0d6-db88-44e9-8ce9-280576ec8a05 could not be found. Jul 28 05:31:35.800942 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Jul 28 05:31:35.808576 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-f86ca424-2fbc-414d-9021-feb2ab43842d tempest-VolumesSnapshotsTestJSON-921490070 tempest-VolumesSnapshotsTestJSON-921490070-project] Returning 404 to user: Snapshot 4939b0d6-db88-44e9-8ce9-280576ec8a05 could not be found. {{(pid=124483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 05:31:35.808576 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-f86ca424-2fbc-414d-9021-feb2ab43842d tempest-VolumesSnapshotsTestJSON-921490070 tempest-VolumesSnapshotsTestJSON-921490070-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/4939b0d6-db88-44e9-8ce9-280576ec8a05" status: 404 len: 111 microversion: 2.1 time: 0.067680 Jul 28 05:31:35.808576 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 13/30] 10.222.0.33 () {58 vars in 1251 bytes} [Thu Jul 28 05:31:35 2022] GET /compute/v2.1/os-snapshots/4939b0d6-db88-44e9-8ce9-280576ec8a05 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 05:31:35.814527 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-8623799c-d677-4edc-9102-ad9d0fe59def tempest-VolumesSnapshotsTestJSON-921490070 tempest-VolumesSnapshotsTestJSON-921490070-project] Calling method '.version_select at 0x7f25e21e0280>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:31:36.203546 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-8623799c-d677-4edc-9102-ad9d0fe59def tempest-VolumesSnapshotsTestJSON-921490070 tempest-VolumesSnapshotsTestJSON-921490070-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/a62871e0-19db-417c-895f-77813f7017bf" status: 202 len: 0 microversion: 2.1 time: 0.390053 Jul 28 05:31:36.204711 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 18/31] 10.222.0.33 () {58 vars in 1248 bytes} [Thu Jul 28 05:31:35 2022] DELETE /compute/v2.1/os-volumes/a62871e0-19db-417c-895f-77813f7017bf => generated 0 bytes in 396 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 05:31:36.219909 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-ffaac30c-ab61-424c-a455-46701d1b07f5 tempest-VolumesSnapshotsTestJSON-921490070 tempest-VolumesSnapshotsTestJSON-921490070-project] Calling method '.version_select at 0x7f25e21e0ee0>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:31:36.347678 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-ffaac30c-ab61-424c-a455-46701d1b07f5 tempest-VolumesSnapshotsTestJSON-921490070 tempest-VolumesSnapshotsTestJSON-921490070-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/a62871e0-19db-417c-895f-77813f7017bf" status: 200 len: 344 microversion: 2.1 time: 0.138746 Jul 28 05:31:36.348597 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 19/32] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Jul 28 05:31:36 2022] GET /compute/v2.1/os-volumes/a62871e0-19db-417c-895f-77813f7017bf => generated 344 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:31:36.571605 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-f6c93a74-8fd7-4739-89b0-b196288e19c9 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Action: 'create', calling method: .version_select at 0x7f25e2243e50>, body: {"keypair": {"name": "tempest-keypair-674403098", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqzsAqJ8pwMGxzAGtS+R+h+cBwQB+QmV5zmnbwGu7h//E6U4SkNAU3c5C0BG/2uFoecV02S2bSOBus2rWWWsYq6KpwjwuQzr0MkdVQh4zuJxcDPUxozyiFmtoXbQsQ2vQ=="}} {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:31:36.701783 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.quota [None req-f6c93a74-8fd7-4739-89b0-b196288e19c9 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Getting quotas for project 7b96e460476f4bc9b35224e38b33f4c7. Resources: {'key_pairs'} {{(pid=124483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 05:31:36.714714 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.quota [None req-f6c93a74-8fd7-4739-89b0-b196288e19c9 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Getting quotas for user b3c43b517c8a464c93f0ce620826ad35 and project 7b96e460476f4bc9b35224e38b33f4c7. Resources: {'key_pairs'} {{(pid=124483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 05:31:36.788934 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-590e9d50-0ecb-408e-a37f-5513c1186597 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1530846524", "imageRef": "4f0ce061-6677-4c2a-9ee1-54a100f21462", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:31:36.952273 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-f6c93a74-8fd7-4739-89b0-b196288e19c9 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.883208 Jul 28 05:31:36.972238 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 14/33] 10.222.0.33 () {60 vars in 1159 bytes} [Thu Jul 28 05:31:36 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 05:31:37.002841 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.network.neutron [None req-590e9d50-0ecb-408e-a37f-5513c1186597 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] validate_networks() for [('11838418-6b14-40b8-a589-613bdb83fff4', None, None, None, None, None)] {{(pid=124482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 05:31:37.363423 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-b5372bc5-2ef3-4635-88a3-9d98844ee804 tempest-VolumesSnapshotsTestJSON-921490070 tempest-VolumesSnapshotsTestJSON-921490070-project] Calling method '.version_select at 0x7f25e21693a0>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:31:37.433062 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.wsgi [None req-b5372bc5-2ef3-4635-88a3-9d98844ee804 tempest-VolumesSnapshotsTestJSON-921490070 tempest-VolumesSnapshotsTestJSON-921490070-project] HTTP exception thrown: Volume a62871e0-19db-417c-895f-77813f7017bf could not be found. Jul 28 05:31:37.434324 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-b5372bc5-2ef3-4635-88a3-9d98844ee804 tempest-VolumesSnapshotsTestJSON-921490070 tempest-VolumesSnapshotsTestJSON-921490070-project] Request method failure captured: Jul 28 05:31:37.434324 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: request: GET /compute/v2.1/os-volumes/a62871e0-19db-417c-895f-77813f7017bf HTTP/1.1 Jul 28 05:31:37.434324 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Accept: application/json Jul 28 05:31:37.434324 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Accept-Encoding: identity Jul 28 05:31:37.434324 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Connection: close Jul 28 05:31:37.434324 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Content-Length: 0 Jul 28 05:31:37.434324 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Content-Type: application/json Jul 28 05:31:37.434324 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Host: 10.222.0.33 Jul 28 05:31:37.434324 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Openstack-System-Scope: None Jul 28 05:31:37.434324 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: User-Agent: python-urllib3/1.26.10 Jul 28 05:31:37.434324 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Auth-Token: gAAAAABi4h8shCvhGcWpspWqH0JcslnROqE2nvrrKUPy7jbGxu-UJJvdwru7pqAgeb_y9MLeYc6cHDL0ID0lrPpYMFnlHZ4-BRMId6F8VKlXTWMk3DJfrQaKBJJ_xdLWAbKy_BOhGk2rFJDoUmBCQibl8sf4QOxvvG8TWeH793unFOzX9woh2xY Jul 28 05:31:37.434324 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Domain-Id: None Jul 28 05:31:37.434324 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Domain-Name: None Jul 28 05:31:37.434324 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Identity-Status: Confirmed Jul 28 05:31:37.434324 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Is-Admin-Project: True Jul 28 05:31:37.434324 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Project-Domain-Id: default Jul 28 05:31:37.434324 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Project-Domain-Name: Default Jul 28 05:31:37.434324 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Project-Id: fe6ba5ebeed545748c37785b9cd087fe Jul 28 05:31:37.434324 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-921490070 Jul 28 05:31:37.434324 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Role: member,reader Jul 28 05:31:37.434324 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Roles: member,reader Jul 28 05:31:37.436561 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fe6ba5ebeed545748c37785b9cd087fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe6ba5ebeed545748c37785b9cd087fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fe6ba5ebeed545748c37785b9cd087fe", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe6ba5ebeed545748c37785b9cd087fe"}]}] Jul 28 05:31:37.436561 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Tenant: tempest-VolumesSnapshotsTestJSON-921490070 Jul 28 05:31:37.436561 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Tenant-Id: fe6ba5ebeed545748c37785b9cd087fe Jul 28 05:31:37.436561 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-921490070 Jul 28 05:31:37.436561 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-User: tempest-VolumesSnapshotsTestJSON-921490070-project Jul 28 05:31:37.436561 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-User-Domain-Id: default Jul 28 05:31:37.436561 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-User-Domain-Name: Default Jul 28 05:31:37.436561 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-User-Id: 2008109b89af4620b2de74464b4c9758 Jul 28 05:31:37.436561 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-User-Name: tempest-VolumesSnapshotsTestJSON-921490070-project Jul 28 05:31:37.436561 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: method: Jul 28 05:31:37.436561 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: exception: Volume a62871e0-19db-417c-895f-77813f7017bf could not be found. Jul 28 05:31:37.436561 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: action_args: {'id': 'a62871e0-19db-417c-895f-77813f7017bf'} Jul 28 05:31:37.436561 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 05:31:37.437248 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:31:37.437248 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 05:31:37.437248 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 05:31:37.437248 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 05:31:37.437248 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 05:31:37.437248 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 05:31:37.437248 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 05:31:37.437248 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 05:31:37.437248 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 05:31:37.437248 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 05:31:37.437248 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 05:31:37.437248 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 05:31:37.437248 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 05:31:37.437248 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 05:31:37.437248 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 05:31:37.437248 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a62871e0-19db-417c-895f-77813f7017bf could not be found. (HTTP 404) (Request-ID: req-2a308a03-ea24-4447-b8ed-1f6c4cde488e) Jul 28 05:31:37.437248 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Jul 28 05:31:37.437248 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:31:37.437248 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Jul 28 05:31:37.439030 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:31:37.439030 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 28 05:31:37.439030 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 28 05:31:37.439030 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 05:31:37.439030 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 05:31:37.439030 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 05:31:37.439030 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 05:31:37.439030 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 05:31:37.439030 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 05:31:37.439030 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 05:31:37.439030 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 05:31:37.439030 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 05:31:37.439030 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 05:31:37.439030 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 05:31:37.439030 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 05:31:37.439030 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 05:31:37.439030 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 05:31:37.439030 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 05:31:37.439030 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 05:31:37.440979 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 05:31:37.440979 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 05:31:37.440979 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 05:31:37.440979 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 05:31:37.440979 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a62871e0-19db-417c-895f-77813f7017bf could not be found. Jul 28 05:31:37.440979 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Jul 28 05:31:37.440979 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:31:37.440979 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Jul 28 05:31:37.440979 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:31:37.440979 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:31:37.440979 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:31:37.440979 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 05:31:37.440979 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 05:31:37.440979 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 05:31:37.440979 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 05:31:37.440979 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 05:31:37.440979 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:31:37.440979 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 28 05:31:37.440979 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 05:31:37.443132 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a62871e0-19db-417c-895f-77813f7017bf could not be found. Jul 28 05:31:37.443132 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Jul 28 05:31:37.443132 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:31:37.443132 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Jul 28 05:31:37.443132 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:31:37.443132 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:31:37.443132 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:31:37.443132 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 05:31:37.443132 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 05:31:37.443132 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a62871e0-19db-417c-895f-77813f7017bf could not be found. Jul 28 05:31:37.443132 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Jul 28 05:31:37.443132 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-b5372bc5-2ef3-4635-88a3-9d98844ee804 tempest-VolumesSnapshotsTestJSON-921490070 tempest-VolumesSnapshotsTestJSON-921490070-project] Returning 404 to user: Volume a62871e0-19db-417c-895f-77813f7017bf could not be found. {{(pid=124483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 05:31:37.443132 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-b5372bc5-2ef3-4635-88a3-9d98844ee804 tempest-VolumesSnapshotsTestJSON-921490070 tempest-VolumesSnapshotsTestJSON-921490070-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/a62871e0-19db-417c-895f-77813f7017bf" status: 404 len: 109 microversion: 2.1 time: 0.077625 Jul 28 05:31:37.443132 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 15/34] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Jul 28 05:31:37 2022] GET /compute/v2.1/os-volumes/a62871e0-19db-417c-895f-77813f7017bf => generated 109 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 05:31:37.456873 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-d9ab21be-f651-4dd6-9d80-27884cfe3949 tempest-VolumesSnapshotsTestJSON-921490070 tempest-VolumesSnapshotsTestJSON-921490070-project] Calling method '.version_select at 0x7f25e21bf940>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:31:37.531329 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.wsgi [None req-d9ab21be-f651-4dd6-9d80-27884cfe3949 tempest-VolumesSnapshotsTestJSON-921490070 tempest-VolumesSnapshotsTestJSON-921490070-project] HTTP exception thrown: Volume a62871e0-19db-417c-895f-77813f7017bf could not be found. Jul 28 05:31:37.534146 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-d9ab21be-f651-4dd6-9d80-27884cfe3949 tempest-VolumesSnapshotsTestJSON-921490070 tempest-VolumesSnapshotsTestJSON-921490070-project] Request method failure captured: Jul 28 05:31:37.534146 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: request: DELETE /compute/v2.1/os-volumes/a62871e0-19db-417c-895f-77813f7017bf HTTP/1.1 Jul 28 05:31:37.534146 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Accept: application/json Jul 28 05:31:37.534146 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Accept-Encoding: identity Jul 28 05:31:37.534146 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Connection: close Jul 28 05:31:37.534146 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Content-Length: 0 Jul 28 05:31:37.534146 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Content-Type: application/json Jul 28 05:31:37.534146 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Host: 10.222.0.33 Jul 28 05:31:37.534146 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Openstack-System-Scope: None Jul 28 05:31:37.534146 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: User-Agent: python-urllib3/1.26.10 Jul 28 05:31:37.534146 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Auth-Token: gAAAAABi4h8shCvhGcWpspWqH0JcslnROqE2nvrrKUPy7jbGxu-UJJvdwru7pqAgeb_y9MLeYc6cHDL0ID0lrPpYMFnlHZ4-BRMId6F8VKlXTWMk3DJfrQaKBJJ_xdLWAbKy_BOhGk2rFJDoUmBCQibl8sf4QOxvvG8TWeH793unFOzX9woh2xY Jul 28 05:31:37.534146 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Domain-Id: None Jul 28 05:31:37.534146 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Domain-Name: None Jul 28 05:31:37.534146 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Identity-Status: Confirmed Jul 28 05:31:37.534146 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Is-Admin-Project: True Jul 28 05:31:37.534146 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Project-Domain-Id: default Jul 28 05:31:37.534146 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Project-Domain-Name: Default Jul 28 05:31:37.534146 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Project-Id: fe6ba5ebeed545748c37785b9cd087fe Jul 28 05:31:37.534146 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-921490070 Jul 28 05:31:37.534146 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Role: member,reader Jul 28 05:31:37.534146 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Roles: member,reader Jul 28 05:31:37.535250 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fe6ba5ebeed545748c37785b9cd087fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe6ba5ebeed545748c37785b9cd087fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fe6ba5ebeed545748c37785b9cd087fe", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe6ba5ebeed545748c37785b9cd087fe"}]}] Jul 28 05:31:37.535250 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Tenant: tempest-VolumesSnapshotsTestJSON-921490070 Jul 28 05:31:37.535250 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Tenant-Id: fe6ba5ebeed545748c37785b9cd087fe Jul 28 05:31:37.535250 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-921490070 Jul 28 05:31:37.535250 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-User: tempest-VolumesSnapshotsTestJSON-921490070-project Jul 28 05:31:37.535250 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-User-Domain-Id: default Jul 28 05:31:37.535250 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-User-Domain-Name: Default Jul 28 05:31:37.535250 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-User-Id: 2008109b89af4620b2de74464b4c9758 Jul 28 05:31:37.535250 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-User-Name: tempest-VolumesSnapshotsTestJSON-921490070-project Jul 28 05:31:37.535250 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: method: Jul 28 05:31:37.535250 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: exception: Volume a62871e0-19db-417c-895f-77813f7017bf could not be found. Jul 28 05:31:37.535250 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: action_args: {'id': 'a62871e0-19db-417c-895f-77813f7017bf'} Jul 28 05:31:37.535250 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 05:31:37.536184 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:31:37.536184 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 05:31:37.536184 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 05:31:37.536184 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 05:31:37.536184 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 05:31:37.536184 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 05:31:37.536184 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 05:31:37.536184 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 05:31:37.536184 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 05:31:37.536184 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 05:31:37.536184 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 05:31:37.536184 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 05:31:37.536184 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 05:31:37.536184 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 05:31:37.536184 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 05:31:37.536184 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a62871e0-19db-417c-895f-77813f7017bf could not be found. (HTTP 404) (Request-ID: req-3827af15-35fc-4406-b0fb-01675b80c0ff) Jul 28 05:31:37.536184 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Jul 28 05:31:37.536184 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:31:37.536184 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Jul 28 05:31:37.537096 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:31:37.537096 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 28 05:31:37.537096 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 28 05:31:37.537096 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 05:31:37.537096 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 05:31:37.537096 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 05:31:37.537096 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 05:31:37.537096 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 05:31:37.537096 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 05:31:37.537096 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 05:31:37.537096 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 05:31:37.537096 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 05:31:37.537096 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 05:31:37.537096 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 05:31:37.537096 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 05:31:37.537096 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 05:31:37.537096 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 05:31:37.537096 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 05:31:37.537096 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 05:31:37.538127 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 05:31:37.538127 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 05:31:37.538127 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 05:31:37.538127 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 05:31:37.538127 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a62871e0-19db-417c-895f-77813f7017bf could not be found. Jul 28 05:31:37.538127 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Jul 28 05:31:37.538127 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:31:37.538127 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Jul 28 05:31:37.538127 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:31:37.538127 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:31:37.538127 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:31:37.538127 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 05:31:37.538127 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 05:31:37.538127 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 05:31:37.538127 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 05:31:37.538127 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 05:31:37.538127 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:31:37.538127 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 28 05:31:37.538127 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 05:31:37.539006 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a62871e0-19db-417c-895f-77813f7017bf could not be found. Jul 28 05:31:37.539006 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Jul 28 05:31:37.539006 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:31:37.539006 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Jul 28 05:31:37.539006 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:31:37.539006 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:31:37.539006 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:31:37.539006 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 05:31:37.539006 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 05:31:37.539006 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a62871e0-19db-417c-895f-77813f7017bf could not be found. Jul 28 05:31:37.539006 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Jul 28 05:31:37.543163 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-d9ab21be-f651-4dd6-9d80-27884cfe3949 tempest-VolumesSnapshotsTestJSON-921490070 tempest-VolumesSnapshotsTestJSON-921490070-project] Returning 404 to user: Volume a62871e0-19db-417c-895f-77813f7017bf could not be found. {{(pid=124483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 05:31:37.547770 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-d9ab21be-f651-4dd6-9d80-27884cfe3949 tempest-VolumesSnapshotsTestJSON-921490070 tempest-VolumesSnapshotsTestJSON-921490070-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/a62871e0-19db-417c-895f-77813f7017bf" status: 404 len: 109 microversion: 2.1 time: 0.092340 Jul 28 05:31:37.547770 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 16/35] 10.222.0.33 () {58 vars in 1248 bytes} [Thu Jul 28 05:31:37 2022] DELETE /compute/v2.1/os-volumes/a62871e0-19db-417c-895f-77813f7017bf => generated 109 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 05:31:37.567636 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-f8e5d5e1-9e5e-4f9c-9d97-8a35a0ceac9c tempest-VolumesSnapshotsTestJSON-921490070 tempest-VolumesSnapshotsTestJSON-921490070-project] Calling method '.version_select at 0x7f25e2169dc0>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:31:37.641421 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.wsgi [None req-f8e5d5e1-9e5e-4f9c-9d97-8a35a0ceac9c tempest-VolumesSnapshotsTestJSON-921490070 tempest-VolumesSnapshotsTestJSON-921490070-project] HTTP exception thrown: Volume a62871e0-19db-417c-895f-77813f7017bf could not be found. Jul 28 05:31:37.653420 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-f8e5d5e1-9e5e-4f9c-9d97-8a35a0ceac9c tempest-VolumesSnapshotsTestJSON-921490070 tempest-VolumesSnapshotsTestJSON-921490070-project] Request method failure captured: Jul 28 05:31:37.653420 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: request: GET /compute/v2.1/os-volumes/a62871e0-19db-417c-895f-77813f7017bf HTTP/1.1 Jul 28 05:31:37.653420 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Accept: application/json Jul 28 05:31:37.653420 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Accept-Encoding: identity Jul 28 05:31:37.653420 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Connection: close Jul 28 05:31:37.653420 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Content-Length: 0 Jul 28 05:31:37.653420 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Content-Type: application/json Jul 28 05:31:37.653420 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Host: 10.222.0.33 Jul 28 05:31:37.653420 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Openstack-System-Scope: None Jul 28 05:31:37.653420 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: User-Agent: python-urllib3/1.26.10 Jul 28 05:31:37.653420 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Auth-Token: gAAAAABi4h8shCvhGcWpspWqH0JcslnROqE2nvrrKUPy7jbGxu-UJJvdwru7pqAgeb_y9MLeYc6cHDL0ID0lrPpYMFnlHZ4-BRMId6F8VKlXTWMk3DJfrQaKBJJ_xdLWAbKy_BOhGk2rFJDoUmBCQibl8sf4QOxvvG8TWeH793unFOzX9woh2xY Jul 28 05:31:37.653420 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Domain-Id: None Jul 28 05:31:37.653420 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Domain-Name: None Jul 28 05:31:37.653420 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Identity-Status: Confirmed Jul 28 05:31:37.653420 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Is-Admin-Project: True Jul 28 05:31:37.653420 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Project-Domain-Id: default Jul 28 05:31:37.653420 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Project-Domain-Name: Default Jul 28 05:31:37.653420 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Project-Id: fe6ba5ebeed545748c37785b9cd087fe Jul 28 05:31:37.653420 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-921490070 Jul 28 05:31:37.653420 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Role: member,reader Jul 28 05:31:37.653420 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Roles: member,reader Jul 28 05:31:37.656825 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fe6ba5ebeed545748c37785b9cd087fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe6ba5ebeed545748c37785b9cd087fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fe6ba5ebeed545748c37785b9cd087fe", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe6ba5ebeed545748c37785b9cd087fe"}]}] Jul 28 05:31:37.656825 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Tenant: tempest-VolumesSnapshotsTestJSON-921490070 Jul 28 05:31:37.656825 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Tenant-Id: fe6ba5ebeed545748c37785b9cd087fe Jul 28 05:31:37.656825 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-921490070 Jul 28 05:31:37.656825 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-User: tempest-VolumesSnapshotsTestJSON-921490070-project Jul 28 05:31:37.656825 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-User-Domain-Id: default Jul 28 05:31:37.656825 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-User-Domain-Name: Default Jul 28 05:31:37.656825 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-User-Id: 2008109b89af4620b2de74464b4c9758 Jul 28 05:31:37.656825 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-User-Name: tempest-VolumesSnapshotsTestJSON-921490070-project Jul 28 05:31:37.656825 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: method: Jul 28 05:31:37.656825 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: exception: Volume a62871e0-19db-417c-895f-77813f7017bf could not be found. Jul 28 05:31:37.656825 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: action_args: {'id': 'a62871e0-19db-417c-895f-77813f7017bf'} Jul 28 05:31:37.656825 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 05:31:37.657499 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:31:37.657499 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 05:31:37.657499 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 05:31:37.657499 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 05:31:37.657499 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 05:31:37.657499 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 05:31:37.657499 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 05:31:37.657499 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 05:31:37.657499 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 05:31:37.657499 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 05:31:37.657499 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 05:31:37.657499 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 05:31:37.657499 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 05:31:37.657499 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 05:31:37.657499 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 05:31:37.657499 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a62871e0-19db-417c-895f-77813f7017bf could not be found. (HTTP 404) (Request-ID: req-daec05c4-905e-4b0e-8a42-7372c1173e9e) Jul 28 05:31:37.657499 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Jul 28 05:31:37.657499 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:31:37.657499 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Jul 28 05:31:37.658419 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:31:37.658419 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 28 05:31:37.658419 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 28 05:31:37.658419 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 05:31:37.658419 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 05:31:37.658419 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 05:31:37.658419 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 05:31:37.658419 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 05:31:37.658419 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 05:31:37.658419 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 05:31:37.658419 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 05:31:37.658419 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 05:31:37.658419 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 05:31:37.658419 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 05:31:37.658419 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 05:31:37.658419 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 05:31:37.658419 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 05:31:37.658419 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 05:31:37.658419 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 05:31:37.659292 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 05:31:37.659292 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 05:31:37.659292 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 05:31:37.659292 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 05:31:37.659292 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a62871e0-19db-417c-895f-77813f7017bf could not be found. Jul 28 05:31:37.659292 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Jul 28 05:31:37.659292 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:31:37.659292 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Jul 28 05:31:37.659292 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:31:37.659292 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:31:37.659292 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:31:37.659292 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 05:31:37.659292 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 05:31:37.659292 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 05:31:37.659292 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 05:31:37.659292 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 05:31:37.659292 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:31:37.659292 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 28 05:31:37.659292 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 05:31:37.661225 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a62871e0-19db-417c-895f-77813f7017bf could not be found. Jul 28 05:31:37.661225 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Jul 28 05:31:37.661225 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:31:37.661225 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Jul 28 05:31:37.661225 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:31:37.661225 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:31:37.661225 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:31:37.661225 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 05:31:37.661225 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 05:31:37.661225 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a62871e0-19db-417c-895f-77813f7017bf could not be found. Jul 28 05:31:37.661225 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Jul 28 05:31:37.661225 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-f8e5d5e1-9e5e-4f9c-9d97-8a35a0ceac9c tempest-VolumesSnapshotsTestJSON-921490070 tempest-VolumesSnapshotsTestJSON-921490070-project] Returning 404 to user: Volume a62871e0-19db-417c-895f-77813f7017bf could not be found. {{(pid=124483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 05:31:37.663436 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-f8e5d5e1-9e5e-4f9c-9d97-8a35a0ceac9c tempest-VolumesSnapshotsTestJSON-921490070 tempest-VolumesSnapshotsTestJSON-921490070-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/a62871e0-19db-417c-895f-77813f7017bf" status: 404 len: 109 microversion: 2.1 time: 0.103859 Jul 28 05:31:37.664569 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 17/36] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Jul 28 05:31:37 2022] GET /compute/v2.1/os-volumes/a62871e0-19db-417c-895f-77813f7017bf => generated 109 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 05:31:39.289219 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-590e9d50-0ecb-408e-a37f-5513c1186597 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Flavor limits 0:0:0 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 05:31:39.289743 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-590e9d50-0ecb-408e-a37f-5513c1186597 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Image limits 0:0:0 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 05:31:39.290367 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-590e9d50-0ecb-408e-a37f-5513c1186597 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Flavor pref 0:0:0 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 05:31:39.291212 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-590e9d50-0ecb-408e-a37f-5513c1186597 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Image pref 0:0:0 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 05:31:39.291710 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-590e9d50-0ecb-408e-a37f-5513c1186597 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 05:31:39.323746 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-590e9d50-0ecb-408e-a37f-5513c1186597 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:31:39.324814 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-590e9d50-0ecb-408e-a37f-5513c1186597 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:31:39.328206 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-590e9d50-0ecb-408e-a37f-5513c1186597 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:31:39.328661 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-590e9d50-0ecb-408e-a37f-5513c1186597 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:31:39.400630 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.quota [None req-590e9d50-0ecb-408e-a37f-5513c1186597 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Getting quotas for project 99f094bca18d4939bb22f8d076d3a35c. Resources: {'ram', 'instances', 'cores'} {{(pid=124482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 05:31:39.418290 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.quota [None req-590e9d50-0ecb-408e-a37f-5513c1186597 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Getting quotas for user 4fcc81558e8f4224ad2ea6fb2b7bf0f9 and project 99f094bca18d4939bb22f8d076d3a35c. Resources: {'ram', 'instances', 'cores'} {{(pid=124482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 05:31:39.455715 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-590e9d50-0ecb-408e-a37f-5513c1186597 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Going to run 1 instances... {{(pid=124482) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 05:31:39.461769 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-590e9d50-0ecb-408e-a37f-5513c1186597 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: d70d71f4-de27-4d62-acad-c6e9a7a7225e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f0ce061-6677-4c2a-9ee1-54a100f21462',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 05:31:39.696525 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-590e9d50-0ecb-408e-a37f-5513c1186597 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.026914 Jul 28 05:31:39.697511 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 20/37] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Jul 28 05:31:36 2022] POST /compute/v2.1/servers => generated 383 bytes in 3028 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 05:31:39.718939 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-c9d9f132-4f57-4747-a8f9-d2f22756ff3d tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:31:39.721526 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-c9d9f132-4f57-4747-a8f9-d2f22756ff3d tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: d70d71f4-de27-4d62-acad-c6e9a7a7225e] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:31:40.022086 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-c9d9f132-4f57-4747-a8f9-d2f22756ff3d tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:31:40.073493 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-c9d9f132-4f57-4747-a8f9-d2f22756ff3d tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/d70d71f4-de27-4d62-acad-c6e9a7a7225e" status: 200 len: 1222 microversion: 2.1 time: 0.357570 Jul 28 05:31:40.073493 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 18/38] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:31:39 2022] GET /compute/v2.1/servers/d70d71f4-de27-4d62-acad-c6e9a7a7225e => generated 1222 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:31:40.366237 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-5ff71509-127c-4fb7-82db-72dc58c880dc tempest-VolumesTestJSON-47987876 tempest-VolumesTestJSON-47987876-project] Calling method '.version_select at 0x7f25e2169820>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:31:40.369351 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-71e352c2-fe55-4b9a-a4e9-a795772aa4f7 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1550276892", "imageRef": "4f0ce061-6677-4c2a-9ee1-54a100f21462", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:31:40.476572 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-5ff71509-127c-4fb7-82db-72dc58c880dc tempest-VolumesTestJSON-47987876 tempest-VolumesTestJSON-47987876-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/3df28d21-0fc8-484b-a645-18dec5c90b94" status: 200 len: 351 microversion: 2.1 time: 0.118133 Jul 28 05:31:40.477635 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 19/39] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Jul 28 05:31:40 2022] GET /compute/v2.1/os-volumes/3df28d21-0fc8-484b-a645-18dec5c90b94 => generated 351 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:31:40.524963 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.network.neutron [None req-71e352c2-fe55-4b9a-a4e9-a795772aa4f7 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] validate_networks() for [('11838418-6b14-40b8-a589-613bdb83fff4', None, None, None, None, None)] {{(pid=124482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 05:31:42.189115 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-df2954a6-4415-4e2f-bc74-1f2f6f39dab5 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1716391783", "imageRef": "4f0ce061-6677-4c2a-9ee1-54a100f21462", "flavorRef": "452", "networks": [{"uuid": "2b55cf41-f4eb-4d40-ba49-8fdf6c64b2ed"}]}} {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:31:42.270001 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-71e352c2-fe55-4b9a-a4e9-a795772aa4f7 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Flavor limits 0:0:0 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 05:31:42.271460 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-71e352c2-fe55-4b9a-a4e9-a795772aa4f7 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Image limits 0:0:0 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 05:31:42.273738 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-71e352c2-fe55-4b9a-a4e9-a795772aa4f7 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Flavor pref 0:0:0 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 05:31:42.275769 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-71e352c2-fe55-4b9a-a4e9-a795772aa4f7 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Image pref 0:0:0 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 05:31:42.276774 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-71e352c2-fe55-4b9a-a4e9-a795772aa4f7 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 05:31:42.299531 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-71e352c2-fe55-4b9a-a4e9-a795772aa4f7 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:31:42.301819 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-71e352c2-fe55-4b9a-a4e9-a795772aa4f7 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:31:42.305604 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-71e352c2-fe55-4b9a-a4e9-a795772aa4f7 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:31:42.306483 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-71e352c2-fe55-4b9a-a4e9-a795772aa4f7 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:31:42.352604 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.quota [None req-71e352c2-fe55-4b9a-a4e9-a795772aa4f7 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Getting quotas for project 99f094bca18d4939bb22f8d076d3a35c. Resources: {'ram', 'instances', 'cores'} {{(pid=124482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 05:31:42.365613 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.quota [None req-71e352c2-fe55-4b9a-a4e9-a795772aa4f7 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Getting quotas for user 4fcc81558e8f4224ad2ea6fb2b7bf0f9 and project 99f094bca18d4939bb22f8d076d3a35c. Resources: {'ram', 'instances', 'cores'} {{(pid=124482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 05:31:42.404637 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-71e352c2-fe55-4b9a-a4e9-a795772aa4f7 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Going to run 1 instances... {{(pid=124482) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 05:31:42.409960 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-71e352c2-fe55-4b9a-a4e9-a795772aa4f7 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 86f5c96f-2d88-48b0-862e-ce27c19abfb4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f0ce061-6677-4c2a-9ee1-54a100f21462',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 05:31:42.415373 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.network.neutron [None req-df2954a6-4415-4e2f-bc74-1f2f6f39dab5 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] validate_networks() for [('2b55cf41-f4eb-4d40-ba49-8fdf6c64b2ed', None, None, None, None, None)] {{(pid=124483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 05:31:42.622321 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-71e352c2-fe55-4b9a-a4e9-a795772aa4f7 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.286849 Jul 28 05:31:42.631155 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 21/40] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Jul 28 05:31:40 2022] POST /compute/v2.1/servers => generated 383 bytes in 2300 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 05:31:42.655087 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-4130f916-7a6d-4fbc-a873-aad434014e88 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:31:42.658293 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-4130f916-7a6d-4fbc-a873-aad434014e88 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 86f5c96f-2d88-48b0-862e-ce27c19abfb4] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:31:43.095167 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-4130f916-7a6d-4fbc-a873-aad434014e88 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:31:43.123177 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-4130f916-7a6d-4fbc-a873-aad434014e88 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4" status: 200 len: 1222 microversion: 2.1 time: 0.487563 Jul 28 05:31:43.134101 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 22/41] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:31:42 2022] GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4 => generated 1222 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:31:43.155169 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-6f99a4a1-22a6-4fac-9a0b-9bff3f871cf4 tempest-VolumesTestJSON-47987876 tempest-VolumesTestJSON-47987876-project] Calling method '.version_select at 0x7f25e20f04c0>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:31:43.277149 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-6f99a4a1-22a6-4fac-9a0b-9bff3f871cf4 tempest-VolumesTestJSON-47987876 tempest-VolumesTestJSON-47987876-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/aed8e55e-211a-422a-bad4-7f837384308d" status: 200 len: 351 microversion: 2.1 time: 0.141623 Jul 28 05:31:43.279107 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 23/42] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Jul 28 05:31:43 2022] GET /compute/v2.1/os-volumes/aed8e55e-211a-422a-bad4-7f837384308d => generated 351 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:31:44.150544 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-61c399a5-ce43-4a0a-9f2b-796896ed30af tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:31:44.153648 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-61c399a5-ce43-4a0a-9f2b-796896ed30af tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 86f5c96f-2d88-48b0-862e-ce27c19abfb4] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:31:44.509857 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-61c399a5-ce43-4a0a-9f2b-796896ed30af tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:31:44.520905 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-61c399a5-ce43-4a0a-9f2b-796896ed30af tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4" status: 200 len: 1222 microversion: 2.1 time: 0.376156 Jul 28 05:31:44.543109 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 24/43] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:31:44 2022] GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4 => generated 1222 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:31:45.754924 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-de0ccbbf-5402-4275-aafa-6f83cad4b7d2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Action: 'create', calling method: .version_select at 0x7f25e10a0ee0>, body: {"keypair": {"name": "tempest-keypair-1162946105", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNMPTzGv5ie/pSjPYuUfdZzHvpZ9dbxEN6f8YrrB17I8/OcdHpn7AO2y7klMNYHF1t2UdN9kpdyfm7lD5Oq+p68++lyvRqb+2cgl8Lkh234MBTZ+jCwyPpS3v7mvB3DzBg=="}} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:31:45.824525 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.quota [None req-de0ccbbf-5402-4275-aafa-6f83cad4b7d2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Getting quotas for project d6e54a77d2aa469b8c0197d99170d978. Resources: {'key_pairs'} {{(pid=124482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 05:31:45.845868 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.quota [None req-de0ccbbf-5402-4275-aafa-6f83cad4b7d2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Getting quotas for user 22fddcc9952a459899e48a93d1d962db and project d6e54a77d2aa469b8c0197d99170d978. Resources: {'key_pairs'} {{(pid=124482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 05:31:45.990090 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.virt.hardware [None req-df2954a6-4415-4e2f-bc74-1f2f6f39dab5 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Flavor limits 0:0:0 {{(pid=124483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 05:31:45.990591 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.virt.hardware [None req-df2954a6-4415-4e2f-bc74-1f2f6f39dab5 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Image limits 0:0:0 {{(pid=124483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 05:31:45.991001 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.virt.hardware [None req-df2954a6-4415-4e2f-bc74-1f2f6f39dab5 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Flavor pref 0:0:0 {{(pid=124483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 05:31:45.991414 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.virt.hardware [None req-df2954a6-4415-4e2f-bc74-1f2f6f39dab5 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Image pref 0:0:0 {{(pid=124483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 05:31:45.998114 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.virt.hardware [None req-df2954a6-4415-4e2f-bc74-1f2f6f39dab5 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 05:31:46.044918 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-df2954a6-4415-4e2f-bc74-1f2f6f39dab5 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:31:46.057646 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-df2954a6-4415-4e2f-bc74-1f2f6f39dab5 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:31:46.058562 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-df2954a6-4415-4e2f-bc74-1f2f6f39dab5 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:31:46.059006 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-df2954a6-4415-4e2f-bc74-1f2f6f39dab5 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:31:46.066966 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-de0ccbbf-5402-4275-aafa-6f83cad4b7d2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.620736 Jul 28 05:31:46.068055 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 25/44] 10.222.0.33 () {62 vars in 1200 bytes} [Thu Jul 28 05:31:45 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 624 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 28 05:31:46.072978 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-f49fa782-246e-4d65-b10c-203e2d90e273 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:31:46.081796 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-f49fa782-246e-4d65-b10c-203e2d90e273 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 86f5c96f-2d88-48b0-862e-ce27c19abfb4] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:31:46.104692 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f49fa782-246e-4d65-b10c-203e2d90e273 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:31:46.111238 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f49fa782-246e-4d65-b10c-203e2d90e273 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:31:46.113229 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f49fa782-246e-4d65-b10c-203e2d90e273 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:31:46.113776 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f49fa782-246e-4d65-b10c-203e2d90e273 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:31:46.119524 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.quota [None req-df2954a6-4415-4e2f-bc74-1f2f6f39dab5 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Getting quotas for project ee5ed205b4a048e18443c6d18b871a90. Resources: {'ram', 'instances', 'cores'} {{(pid=124483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 05:31:46.129190 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.quota [None req-df2954a6-4415-4e2f-bc74-1f2f6f39dab5 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Getting quotas for user b3124696ed4c40029066ceef822f35b7 and project ee5ed205b4a048e18443c6d18b871a90. Resources: {'ram', 'instances', 'cores'} {{(pid=124483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 05:31:46.179504 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-df2954a6-4415-4e2f-bc74-1f2f6f39dab5 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Going to run 1 instances... {{(pid=124483) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 05:31:46.186697 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-df2954a6-4415-4e2f-bc74-1f2f6f39dab5 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] [instance: 2e6d57a3-f6d1-4b5a-b313-e6cf26eec103] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f0ce061-6677-4c2a-9ee1-54a100f21462',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 05:31:46.474074 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-df2954a6-4415-4e2f-bc74-1f2f6f39dab5 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.482270 Jul 28 05:31:46.475358 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 20/45] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Jul 28 05:31:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 4484 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 05:31:46.501646 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-7c841336-ccee-401a-90e6-8168d5636d55 tempest-VolumesTestJSON-47987876 tempest-VolumesTestJSON-47987876-project] Calling method '.version_select at 0x7f25e1840670>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:31:46.610349 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-f49fa782-246e-4d65-b10c-203e2d90e273 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:31:46.667279 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-f49fa782-246e-4d65-b10c-203e2d90e273 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4" status: 200 len: 1274 microversion: 2.1 time: 0.579453 Jul 28 05:31:46.668775 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-7c841336-ccee-401a-90e6-8168d5636d55 tempest-VolumesTestJSON-47987876 tempest-VolumesTestJSON-47987876-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/ba1b6639-fa0e-406f-8de6-cb273457d22b" status: 200 len: 351 microversion: 2.1 time: 0.191764 Jul 28 05:31:46.669775 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 26/46] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:31:46 2022] GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4 => generated 1274 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:31:46.683513 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-ada9b1ba-5d34-42bd-a97d-7bb068e2c6a9 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:31:46.684009 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 21/47] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Jul 28 05:31:46 2022] GET /compute/v2.1/os-volumes/ba1b6639-fa0e-406f-8de6-cb273457d22b => generated 351 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:31:46.685946 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-ada9b1ba-5d34-42bd-a97d-7bb068e2c6a9 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] [instance: 2e6d57a3-f6d1-4b5a-b313-e6cf26eec103] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:31:46.702506 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-4370f966-a4c1-4d73-a0eb-a6eff4feb23c tempest-VolumesTestJSON-47987876 tempest-VolumesTestJSON-47987876-project] Calling method '.version_select at 0x7f25e1840d30>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:31:46.889759 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-ada9b1ba-5d34-42bd-a97d-7bb068e2c6a9 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3124696ed4c40029066ceef822f35b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ed205b4a048e18443c6d18b871a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:31:46.903195 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-ada9b1ba-5d34-42bd-a97d-7bb068e2c6a9 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] 10.222.0.33 "GET /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103" status: 200 len: 1215 microversion: 2.1 time: 0.226650 Jul 28 05:31:46.906261 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 27/48] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:31:46 2022] GET /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103 => generated 1215 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:31:46.939048 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-b0ac4aaf-dcb4-4418-98c9-7603558febd3 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1706527813", "imageRef": "4f0ce061-6677-4c2a-9ee1-54a100f21462", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "92779e58-7df4-4404-9045-ca3676cbb72b"}], "security_groups": [{"name": "tempest-securitygroup--1242090249"}], "key_name": "tempest-keypair-674403098", "user_data": "}} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:31:46.972915 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-4370f966-a4c1-4d73-a0eb-a6eff4feb23c tempest-VolumesTestJSON-47987876 tempest-VolumesTestJSON-47987876-project] 10.222.0.33 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.278211 Jul 28 05:31:46.973777 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 22/49] 10.222.0.33 () {58 vars in 1134 bytes} [Thu Jul 28 05:31:46 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:31:46.991539 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-150c033a-2f36-4a09-8985-72a04cd36700 tempest-VolumesTestJSON-47987876 tempest-VolumesTestJSON-47987876-project] Calling method '.version_select at 0x7f25e1848d30>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:31:47.275657 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-150c033a-2f36-4a09-8985-72a04cd36700 tempest-VolumesTestJSON-47987876 tempest-VolumesTestJSON-47987876-project] 10.222.0.33 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.290528 Jul 28 05:31:47.276644 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 23/50] 10.222.0.33 () {58 vars in 1149 bytes} [Thu Jul 28 05:31:46 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:31:47.290419 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-8f1f8bb4-c89b-4a94-8384-d87db4947091 tempest-VolumesTestJSON-47987876 tempest-VolumesTestJSON-47987876-project] Calling method '.version_select at 0x7f25e1848c10>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:31:47.510201 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-8f1f8bb4-c89b-4a94-8384-d87db4947091 tempest-VolumesTestJSON-47987876 tempest-VolumesTestJSON-47987876-project] 10.222.0.33 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.223840 Jul 28 05:31:47.511138 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 24/51] 10.222.0.33 () {58 vars in 1134 bytes} [Thu Jul 28 05:31:47 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:31:47.531909 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.network.neutron [None req-b0ac4aaf-dcb4-4418-98c9-7603558febd3 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] validate_networks() for [('92779e58-7df4-4404-9045-ca3676cbb72b', None, None, None, None, None)] {{(pid=124482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 05:31:48.189860 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-2bca1340-53bc-4a9b-bd85-d9c0e2eec3f9 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Action: 'create', calling method: .version_select at 0x7f25e1840ca0>, body: {"keypair": {"name": "tempest-keypair-2045500188", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLDol+jQLd6H4xniq+qvSkVKWdizfQ3zvMiitQiWP4ePJxF0Vn39S4wFax0r36lVkmUQa/SkbNlui5bOL2s8XPkQ6iKTDZPoLXXT0l01qGYTK0qwmgySku++TnKyUGPxNA=="}} {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:31:48.281287 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.quota [None req-2bca1340-53bc-4a9b-bd85-d9c0e2eec3f9 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Getting quotas for project ba0b7f7639504a25a73c94335d62b98f. Resources: {'key_pairs'} {{(pid=124483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 05:31:48.294649 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.quota [None req-2bca1340-53bc-4a9b-bd85-d9c0e2eec3f9 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Getting quotas for user 0002ebbc629b4dafb109dc94450fe1d8 and project ba0b7f7639504a25a73c94335d62b98f. Resources: {'key_pairs'} {{(pid=124483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 05:31:48.480778 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-2bca1340-53bc-4a9b-bd85-d9c0e2eec3f9 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.968440 Jul 28 05:31:48.483045 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 25/52] 10.222.0.33 () {60 vars in 1159 bytes} [Thu Jul 28 05:31:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:31:48.502553 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-89b5573a-cabb-489e-a467-9b31fb53fd12 tempest-VolumesTestJSON-47987876 tempest-VolumesTestJSON-47987876-project] Calling method '.version_select at 0x7f25e1840af0>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:31:48.817056 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-89b5573a-cabb-489e-a467-9b31fb53fd12 tempest-VolumesTestJSON-47987876 tempest-VolumesTestJSON-47987876-project] 10.222.0.33 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.331731 Jul 28 05:31:48.817837 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 26/53] 10.222.0.33 () {58 vars in 1167 bytes} [Thu Jul 28 05:31:48 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:31:48.826188 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-baafd5a0-db94-4c51-80de-8aa280434e8c tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:31:48.828670 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-baafd5a0-db94-4c51-80de-8aa280434e8c tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 86f5c96f-2d88-48b0-862e-ce27c19abfb4] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:31:48.851081 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-baafd5a0-db94-4c51-80de-8aa280434e8c tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:31:48.855787 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-baafd5a0-db94-4c51-80de-8aa280434e8c tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:31:48.858657 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-baafd5a0-db94-4c51-80de-8aa280434e8c tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:31:48.866271 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-baafd5a0-db94-4c51-80de-8aa280434e8c tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:31:49.303199 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-baafd5a0-db94-4c51-80de-8aa280434e8c tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:31:49.361556 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-baafd5a0-db94-4c51-80de-8aa280434e8c tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4" status: 200 len: 1280 microversion: 2.1 time: 0.528041 Jul 28 05:31:49.382170 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 27/54] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:31:48 2022] GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4 => generated 1280 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:31:49.416480 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-e3d3f139-8b4c-486d-97f7-469d4e022020 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:31:49.418148 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-e3d3f139-8b4c-486d-97f7-469d4e022020 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] [instance: 2e6d57a3-f6d1-4b5a-b313-e6cf26eec103] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:31:49.458079 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-e3d3f139-8b4c-486d-97f7-469d4e022020 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:31:49.471242 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-e3d3f139-8b4c-486d-97f7-469d4e022020 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:31:49.475090 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-e3d3f139-8b4c-486d-97f7-469d4e022020 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:31:49.476292 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-e3d3f139-8b4c-486d-97f7-469d4e022020 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:31:49.889347 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-e3d3f139-8b4c-486d-97f7-469d4e022020 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3124696ed4c40029066ceef822f35b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ed205b4a048e18443c6d18b871a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:31:49.906952 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-e3d3f139-8b4c-486d-97f7-469d4e022020 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] 10.222.0.33 "GET /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103" status: 200 len: 1267 microversion: 2.1 time: 0.523312 Jul 28 05:31:49.907616 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 28/55] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:31:49 2022] GET /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103 => generated 1267 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:31:49.924191 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-09a4d77f-65b5-4bcc-b49a-6a633fec7393 tempest-VolumesTestJSON-47987876 tempest-VolumesTestJSON-47987876-project] Calling method '.version_select at 0x7f25e18484c0>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:31:50.234065 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-09a4d77f-65b5-4bcc-b49a-6a633fec7393 tempest-VolumesTestJSON-47987876 tempest-VolumesTestJSON-47987876-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.325227 Jul 28 05:31:50.243389 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 29/56] 10.222.0.33 () {58 vars in 1170 bytes} [Thu Jul 28 05:31:49 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:31:50.250678 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-6d6cb4c1-84b8-4836-a6b6-7988bba22a8f tempest-VolumesTestJSON-47987876 tempest-VolumesTestJSON-47987876-project] Calling method '.version_select at 0x7f25e0783430>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:31:50.336246 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-b0ac4aaf-dcb4-4418-98c9-7603558febd3 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Flavor limits 0:0:0 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 05:31:50.337273 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-b0ac4aaf-dcb4-4418-98c9-7603558febd3 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Image limits 0:0:0 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 05:31:50.337930 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-b0ac4aaf-dcb4-4418-98c9-7603558febd3 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Flavor pref 0:0:0 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 05:31:50.338502 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-b0ac4aaf-dcb4-4418-98c9-7603558febd3 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Image pref 0:0:0 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 05:31:50.339056 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-b0ac4aaf-dcb4-4418-98c9-7603558febd3 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 05:31:50.361707 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b0ac4aaf-dcb4-4418-98c9-7603558febd3 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:31:50.367047 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b0ac4aaf-dcb4-4418-98c9-7603558febd3 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:31:50.368095 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b0ac4aaf-dcb4-4418-98c9-7603558febd3 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:31:50.368684 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b0ac4aaf-dcb4-4418-98c9-7603558febd3 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:31:50.456145 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.quota [None req-b0ac4aaf-dcb4-4418-98c9-7603558febd3 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Getting quotas for project 7b96e460476f4bc9b35224e38b33f4c7. Resources: {'ram', 'instances', 'cores'} {{(pid=124482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 05:31:50.460624 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.quota [None req-b0ac4aaf-dcb4-4418-98c9-7603558febd3 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Getting quotas for user b3c43b517c8a464c93f0ce620826ad35 and project 7b96e460476f4bc9b35224e38b33f4c7. Resources: {'ram', 'instances', 'cores'} {{(pid=124482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 05:31:50.505948 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-b0ac4aaf-dcb4-4418-98c9-7603558febd3 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Going to run 1 instances... {{(pid=124482) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 05:31:50.506142 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-6d6cb4c1-84b8-4836-a6b6-7988bba22a8f tempest-VolumesTestJSON-47987876 tempest-VolumesTestJSON-47987876-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.261007 Jul 28 05:31:50.507834 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 30/57] 10.222.0.33 () {58 vars in 1155 bytes} [Thu Jul 28 05:31:50 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:31:50.520936 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-65b7e57e-1f28-4ec6-b3d7-bf59cbc9a674 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:31:50.521914 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-65b7e57e-1f28-4ec6-b3d7-bf59cbc9a674 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 86f5c96f-2d88-48b0-862e-ce27c19abfb4] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:31:50.523129 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-b0ac4aaf-dcb4-4418-98c9-7603558febd3 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f0ce061-6677-4c2a-9ee1-54a100f21462',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 05:31:50.564535 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-65b7e57e-1f28-4ec6-b3d7-bf59cbc9a674 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:31:50.568796 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-65b7e57e-1f28-4ec6-b3d7-bf59cbc9a674 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:31:50.577920 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-65b7e57e-1f28-4ec6-b3d7-bf59cbc9a674 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:31:50.578485 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-65b7e57e-1f28-4ec6-b3d7-bf59cbc9a674 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:31:50.797222 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-b0ac4aaf-dcb4-4418-98c9-7603558febd3 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.884431 Jul 28 05:31:50.798261 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 28/58] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Jul 28 05:31:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 3887 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 05:31:50.807641 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-c1ee7c0b-2e4b-4783-ad5a-23a7ab01fb9f tempest-VolumesTestJSON-47987876 tempest-VolumesTestJSON-47987876-project] Calling method '.version_select at 0x7f25e0799790>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:31:51.127547 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-c1ee7c0b-2e4b-4783-ad5a-23a7ab01fb9f tempest-VolumesTestJSON-47987876 tempest-VolumesTestJSON-47987876-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.327923 Jul 28 05:31:51.138151 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 29/59] 10.222.0.33 () {58 vars in 1188 bytes} [Thu Jul 28 05:31:50 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:31:51.195889 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-9415700e-59a6-480a-a52b-a2a4420a418e tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:31:51.195889 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-9415700e-59a6-480a-a52b-a2a4420a418e tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:31:51.644035 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-9415700e-59a6-480a-a52b-a2a4420a418e tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:31:51.655437 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-9415700e-59a6-480a-a52b-a2a4420a418e tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 200 len: 1237 microversion: 2.1 time: 0.520301 Jul 28 05:31:51.656020 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 30/60] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:31:51 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 1237 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:31:51.671834 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-9006f621-f462-4369-a8fb-f2b11e67669f tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:31:51.672473 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-9006f621-f462-4369-a8fb-f2b11e67669f tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] [instance: 2e6d57a3-f6d1-4b5a-b313-e6cf26eec103] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:31:51.710832 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9006f621-f462-4369-a8fb-f2b11e67669f tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:31:51.712716 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9006f621-f462-4369-a8fb-f2b11e67669f tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:31:51.712716 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9006f621-f462-4369-a8fb-f2b11e67669f tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:31:51.719606 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9006f621-f462-4369-a8fb-f2b11e67669f tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:31:51.772483 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-65b7e57e-1f28-4ec6-b3d7-bf59cbc9a674 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:31:51.792040 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-65b7e57e-1f28-4ec6-b3d7-bf59cbc9a674 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4" status: 200 len: 1280 microversion: 2.1 time: 1.279777 Jul 28 05:31:51.792991 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 31/61] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:31:50 2022] GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4 => generated 1280 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:31:51.847709 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-39487216-f37a-4b36-9c9b-63afc7ca8780 tempest-VolumesTestJSON-47987876 tempest-VolumesTestJSON-47987876-project] Calling method '.version_select at 0x7f25e0783820>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:31:51.940442 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-9006f621-f462-4369-a8fb-f2b11e67669f tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3124696ed4c40029066ceef822f35b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ed205b4a048e18443c6d18b871a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:31:51.952415 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-9006f621-f462-4369-a8fb-f2b11e67669f tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] 10.222.0.33 "GET /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103" status: 200 len: 1273 microversion: 2.1 time: 0.295219 Jul 28 05:31:51.953353 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 31/62] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:31:51 2022] GET /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103 => generated 1273 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:31:52.115857 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-39487216-f37a-4b36-9c9b-63afc7ca8780 tempest-VolumesTestJSON-47987876 tempest-VolumesTestJSON-47987876-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.294515 Jul 28 05:31:52.116802 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 32/63] 10.222.0.33 () {58 vars in 1155 bytes} [Thu Jul 28 05:31:51 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:31:52.680993 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-770ebc2f-5b0c-4079-9777-c75fa2d20a53 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:31:52.682780 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-770ebc2f-5b0c-4079-9777-c75fa2d20a53 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:31:52.819087 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-b7191d37-0b53-4a0a-bd89-4e0763e11d6f tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:31:52.819931 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-b7191d37-0b53-4a0a-bd89-4e0763e11d6f tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 86f5c96f-2d88-48b0-862e-ce27c19abfb4] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:31:52.842454 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-b7191d37-0b53-4a0a-bd89-4e0763e11d6f tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:31:52.848547 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-b7191d37-0b53-4a0a-bd89-4e0763e11d6f tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:31:52.848547 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-b7191d37-0b53-4a0a-bd89-4e0763e11d6f tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:31:52.848547 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-b7191d37-0b53-4a0a-bd89-4e0763e11d6f tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:31:53.127671 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-770ebc2f-5b0c-4079-9777-c75fa2d20a53 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:31:53.139510 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-770ebc2f-5b0c-4079-9777-c75fa2d20a53 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 200 len: 1237 microversion: 2.1 time: 0.460783 Jul 28 05:31:53.162787 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 32/64] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:31:52 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 1237 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:31:53.179311 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-832ed88d-cf26-48cd-bbbe-56c6cfbb9645 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:31:53.194026 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-832ed88d-cf26-48cd-bbbe-56c6cfbb9645 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] [instance: 2e6d57a3-f6d1-4b5a-b313-e6cf26eec103] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:31:53.234777 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-832ed88d-cf26-48cd-bbbe-56c6cfbb9645 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:31:53.235245 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-832ed88d-cf26-48cd-bbbe-56c6cfbb9645 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:31:53.236037 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-832ed88d-cf26-48cd-bbbe-56c6cfbb9645 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:31:53.243258 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-832ed88d-cf26-48cd-bbbe-56c6cfbb9645 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:31:53.378810 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-b7191d37-0b53-4a0a-bd89-4e0763e11d6f tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:31:53.410702 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-b7191d37-0b53-4a0a-bd89-4e0763e11d6f tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4" status: 200 len: 1280 microversion: 2.1 time: 0.592259 Jul 28 05:31:53.411678 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 33/65] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:31:52 2022] GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4 => generated 1280 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:31:53.539939 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-832ed88d-cf26-48cd-bbbe-56c6cfbb9645 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3124696ed4c40029066ceef822f35b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ed205b4a048e18443c6d18b871a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:31:53.549160 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-832ed88d-cf26-48cd-bbbe-56c6cfbb9645 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] 10.222.0.33 "GET /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103" status: 200 len: 1273 microversion: 2.1 time: 0.385514 Jul 28 05:31:53.570359 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 33/66] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:31:53 2022] GET /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103 => generated 1273 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:31:54.186355 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-ce6c46eb-7093-488a-8e1a-0952944ff5a4 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:31:54.186968 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-ce6c46eb-7093-488a-8e1a-0952944ff5a4 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:31:54.207875 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-ce6c46eb-7093-488a-8e1a-0952944ff5a4 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:31:54.208335 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-ce6c46eb-7093-488a-8e1a-0952944ff5a4 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:31:54.209132 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-ce6c46eb-7093-488a-8e1a-0952944ff5a4 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:31:54.218215 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-ce6c46eb-7093-488a-8e1a-0952944ff5a4 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:31:54.434626 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-dca5b678-5bbc-46c1-8f6b-cf6ea6ec4479 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:31:54.437887 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-dca5b678-5bbc-46c1-8f6b-cf6ea6ec4479 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 86f5c96f-2d88-48b0-862e-ce27c19abfb4] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:31:54.444068 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-dca5b678-5bbc-46c1-8f6b-cf6ea6ec4479 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:31:54.444885 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-dca5b678-5bbc-46c1-8f6b-cf6ea6ec4479 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:31:54.446105 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-dca5b678-5bbc-46c1-8f6b-cf6ea6ec4479 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:31:54.446764 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-dca5b678-5bbc-46c1-8f6b-cf6ea6ec4479 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:31:54.514373 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-ce6c46eb-7093-488a-8e1a-0952944ff5a4 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:31:54.524802 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-ce6c46eb-7093-488a-8e1a-0952944ff5a4 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 200 len: 1289 microversion: 2.1 time: 0.342380 Jul 28 05:31:54.528601 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 34/67] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:31:54 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 1289 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:31:54.573420 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-b71b95a6-b968-46be-8699-b6343d4815e1 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:31:54.574131 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-b71b95a6-b968-46be-8699-b6343d4815e1 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] [instance: 2e6d57a3-f6d1-4b5a-b313-e6cf26eec103] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:31:54.584858 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-b71b95a6-b968-46be-8699-b6343d4815e1 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:31:54.585318 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-b71b95a6-b968-46be-8699-b6343d4815e1 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:31:54.590968 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-b71b95a6-b968-46be-8699-b6343d4815e1 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:31:54.591436 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-b71b95a6-b968-46be-8699-b6343d4815e1 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:31:56.077769 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-dca5b678-5bbc-46c1-8f6b-cf6ea6ec4479 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:31:56.088267 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-dca5b678-5bbc-46c1-8f6b-cf6ea6ec4479 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4" status: 200 len: 1322 microversion: 2.1 time: 1.658548 Jul 28 05:31:56.091393 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 34/68] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:31:54 2022] GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4 => generated 1322 bytes in 1663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:31:56.106785 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG dbcounter [-] [124483] Writing DB stats nova_cell0:SELECT=2 {{(pid=124483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:56.115043 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-38055102-fd07-4c52-b5cf-182cec523af5 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-361020094", "imageRef": "4f0ce061-6677-4c2a-9ee1-54a100f21462", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "12676c2f-cd93-405a-a402-b0ee7cfa77c5"}], "security_groups": [{"name": "tempest-securitygroup--913196828"}], "key_name": "tempest-keypair-1162946105", "user_data": "}} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:31:56.149773 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-b71b95a6-b968-46be-8699-b6343d4815e1 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3124696ed4c40029066ceef822f35b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ed205b4a048e18443c6d18b871a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:31:56.180582 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-b71b95a6-b968-46be-8699-b6343d4815e1 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] 10.222.0.33 "GET /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103" status: 200 len: 1315 microversion: 2.1 time: 1.611724 Jul 28 05:31:56.194187 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 35/69] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:31:54 2022] GET /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103 => generated 1315 bytes in 1626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:31:56.225071 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-c972b2a1-b6d5-4b09-9688-48daf2454491 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:31:56.228604 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-c972b2a1-b6d5-4b09-9688-48daf2454491 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:31:56.268241 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-c972b2a1-b6d5-4b09-9688-48daf2454491 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:31:56.272335 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-c972b2a1-b6d5-4b09-9688-48daf2454491 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:31:56.272335 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-c972b2a1-b6d5-4b09-9688-48daf2454491 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:31:56.276531 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-c972b2a1-b6d5-4b09-9688-48daf2454491 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:31:56.826212 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-c972b2a1-b6d5-4b09-9688-48daf2454491 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:31:56.834353 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.network.neutron [None req-38055102-fd07-4c52-b5cf-182cec523af5 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] validate_networks() for [('12676c2f-cd93-405a-a402-b0ee7cfa77c5', None, None, None, None, None)] {{(pid=124482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 05:31:56.843425 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-c972b2a1-b6d5-4b09-9688-48daf2454491 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 200 len: 1295 microversion: 2.1 time: 0.645115 Jul 28 05:31:56.846227 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 36/70] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:31:56 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 1295 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:31:57.121128 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-e8657c0c-b602-489f-9bb6-f1d5f88071b4 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:31:57.121128 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-e8657c0c-b602-489f-9bb6-f1d5f88071b4 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 86f5c96f-2d88-48b0-862e-ce27c19abfb4] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:31:57.133123 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-e8657c0c-b602-489f-9bb6-f1d5f88071b4 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:31:57.139247 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-e8657c0c-b602-489f-9bb6-f1d5f88071b4 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:31:57.143159 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-e8657c0c-b602-489f-9bb6-f1d5f88071b4 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:31:57.143816 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-e8657c0c-b602-489f-9bb6-f1d5f88071b4 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:31:58.333925 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG dbcounter [-] [124483] Writing DB stats nova_cell0:SELECT=16 {{(pid=124483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:58.369216 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-e8657c0c-b602-489f-9bb6-f1d5f88071b4 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:31:58.403864 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-e8657c0c-b602-489f-9bb6-f1d5f88071b4 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4" status: 200 len: 1322 microversion: 2.1 time: 1.287295 Jul 28 05:31:58.406044 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 37/71] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:31:57 2022] GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4 => generated 1322 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:31:58.421875 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-94f21dbd-1edd-442f-a054-5ec826cf8e21 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:31:58.423326 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-94f21dbd-1edd-442f-a054-5ec826cf8e21 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] [instance: 2e6d57a3-f6d1-4b5a-b313-e6cf26eec103] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:31:58.450917 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-94f21dbd-1edd-442f-a054-5ec826cf8e21 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:31:58.453364 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-94f21dbd-1edd-442f-a054-5ec826cf8e21 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:31:58.456443 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-94f21dbd-1edd-442f-a054-5ec826cf8e21 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:31:58.457553 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-94f21dbd-1edd-442f-a054-5ec826cf8e21 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:31:59.148765 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-94f21dbd-1edd-442f-a054-5ec826cf8e21 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3124696ed4c40029066ceef822f35b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ed205b4a048e18443c6d18b871a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:31:59.171130 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-94f21dbd-1edd-442f-a054-5ec826cf8e21 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] 10.222.0.33 "GET /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103" status: 200 len: 1315 microversion: 2.1 time: 0.757527 Jul 28 05:31:59.173023 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 38/72] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:31:58 2022] GET /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103 => generated 1315 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:31:59.179949 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-6a2769bf-dc28-4725-bc1a-296ffccfc59f tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:31:59.183874 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-6a2769bf-dc28-4725-bc1a-296ffccfc59f tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:31:59.199622 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-6a2769bf-dc28-4725-bc1a-296ffccfc59f tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:31:59.206895 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-6a2769bf-dc28-4725-bc1a-296ffccfc59f tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:31:59.206895 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-6a2769bf-dc28-4725-bc1a-296ffccfc59f tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:31:59.206895 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-6a2769bf-dc28-4725-bc1a-296ffccfc59f tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:00.390457 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell0:SELECT=6 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:00.628621 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-6a2769bf-dc28-4725-bc1a-296ffccfc59f tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:00.637729 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-6a2769bf-dc28-4725-bc1a-296ffccfc59f tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 200 len: 1363 microversion: 2.1 time: 1.462410 Jul 28 05:32:00.649489 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 39/73] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:31:59 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 1363 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:00.693368 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-38055102-fd07-4c52-b5cf-182cec523af5 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Flavor limits 0:0:0 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 05:32:00.694001 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-38055102-fd07-4c52-b5cf-182cec523af5 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Image limits 0:0:0 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 05:32:00.694710 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-38055102-fd07-4c52-b5cf-182cec523af5 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Flavor pref 0:0:0 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 05:32:00.695291 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-38055102-fd07-4c52-b5cf-182cec523af5 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Image pref 0:0:0 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 05:32:00.696131 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-38055102-fd07-4c52-b5cf-182cec523af5 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 05:32:00.713111 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-38055102-fd07-4c52-b5cf-182cec523af5 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:00.717926 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-38055102-fd07-4c52-b5cf-182cec523af5 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:00.721877 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-38055102-fd07-4c52-b5cf-182cec523af5 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:00.725716 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-38055102-fd07-4c52-b5cf-182cec523af5 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:00.798866 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.quota [None req-38055102-fd07-4c52-b5cf-182cec523af5 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Getting quotas for project d6e54a77d2aa469b8c0197d99170d978. Resources: {'ram', 'instances', 'cores'} {{(pid=124482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 05:32:00.814355 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:00.821967 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.quota [None req-38055102-fd07-4c52-b5cf-182cec523af5 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Getting quotas for user 22fddcc9952a459899e48a93d1d962db and project d6e54a77d2aa469b8c0197d99170d978. Resources: {'ram', 'instances', 'cores'} {{(pid=124482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 05:32:00.849207 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-38055102-fd07-4c52-b5cf-182cec523af5 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Going to run 1 instances... {{(pid=124482) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 05:32:00.851815 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-38055102-fd07-4c52-b5cf-182cec523af5 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f0ce061-6677-4c2a-9ee1-54a100f21462',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 05:32:00.997079 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [req-490618be-5472-4b4d-9908-6bae9a2f1cce req-87c6a972-ba50-43a3-a902-af39546e731c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d70d71f4-de27-4d62-acad-c6e9a7a7225e", "tag": "c16cb5d0-7376-4ff8-92fe-2ea79594b837"}]} {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:32:01.060665 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [req-490618be-5472-4b4d-9908-6bae9a2f1cce req-87c6a972-ba50-43a3-a902-af39546e731c service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:01.063365 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [req-490618be-5472-4b4d-9908-6bae9a2f1cce req-87c6a972-ba50-43a3-a902-af39546e731c service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:01.103601 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-38055102-fd07-4c52-b5cf-182cec523af5 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 4.995512 Jul 28 05:32:01.110922 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 35/74] 10.222.0.33 () {62 vars in 1188 bytes} [Thu Jul 28 05:31:56 2022] POST /compute/v2.1/servers => generated 401 bytes in 5012 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 28 05:32:01.118344 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-7d887e3a-f116-4345-84e4-39ce05a45c2e tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:01.126137 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-7d887e3a-f116-4345-84e4-39ce05a45c2e tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 86f5c96f-2d88-48b0-862e-ce27c19abfb4] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:01.136222 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.compute.server_external_events [req-490618be-5472-4b4d-9908-6bae9a2f1cce req-87c6a972-ba50-43a3-a902-af39546e731c service nova] Creating event network-changed:c16cb5d0-7376-4ff8-92fe-2ea79594b837 for instance d70d71f4-de27-4d62-acad-c6e9a7a7225e on hv-cinder-79987 Jul 28 05:32:01.136835 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [req-490618be-5472-4b4d-9908-6bae9a2f1cce req-87c6a972-ba50-43a3-a902-af39546e731c service nova] Acquired lock "compute-rpcapi-router" {{(pid=124483) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 28 05:32:01.155506 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-715df95b-52e9-435f-9ece-47df4badcc74 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:01.155506 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-715df95b-52e9-435f-9ece-47df4badcc74 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:01.155506 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-715df95b-52e9-435f-9ece-47df4badcc74 None None] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:01.155506 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-715df95b-52e9-435f-9ece-47df4badcc74 None None] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:01.159027 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7d887e3a-f116-4345-84e4-39ce05a45c2e tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:01.159485 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7d887e3a-f116-4345-84e4-39ce05a45c2e tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:01.160273 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7d887e3a-f116-4345-84e4-39ce05a45c2e tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:01.160714 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7d887e3a-f116-4345-84e4-39ce05a45c2e tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:01.208290 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.compute.rpcapi [None req-715df95b-52e9-435f-9ece-47df4badcc74 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 28 05:32:01.209214 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-715df95b-52e9-435f-9ece-47df4badcc74 None None] Releasing lock "compute-rpcapi-router" {{(pid=124483) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 28 05:32:01.270385 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-715df95b-52e9-435f-9ece-47df4badcc74 None None] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.611552 Jul 28 05:32:01.271053 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 40/75] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:32:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:32:01.276960 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-c1376651-0769-4bed-bc41-40bc049ac36a tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:01.281133 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-c1376651-0769-4bed-bc41-40bc049ac36a tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] [instance: 2e6d57a3-f6d1-4b5a-b313-e6cf26eec103] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:01.299411 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-c1376651-0769-4bed-bc41-40bc049ac36a tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:01.307081 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-c1376651-0769-4bed-bc41-40bc049ac36a tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:01.308493 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-c1376651-0769-4bed-bc41-40bc049ac36a tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:01.309264 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-c1376651-0769-4bed-bc41-40bc049ac36a tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:02.527146 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-7d887e3a-f116-4345-84e4-39ce05a45c2e tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:02.544117 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-7d887e3a-f116-4345-84e4-39ce05a45c2e tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4" status: 200 len: 1322 microversion: 2.1 time: 1.438797 Jul 28 05:32:02.551453 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 36/76] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:01 2022] GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4 => generated 1322 bytes in 1447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:02.583149 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-c1376651-0769-4bed-bc41-40bc049ac36a tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3124696ed4c40029066ceef822f35b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ed205b4a048e18443c6d18b871a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:02.594260 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-c1376651-0769-4bed-bc41-40bc049ac36a tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] 10.222.0.33 "GET /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103" status: 200 len: 1315 microversion: 2.1 time: 1.319180 Jul 28 05:32:02.598235 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 41/77] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:01 2022] GET /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103 => generated 1315 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:02.622905 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-89ebf984-6f69-41a2-a4be-fd75664ef858 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:02.623782 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-89ebf984-6f69-41a2-a4be-fd75664ef858 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:02.657461 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-89ebf984-6f69-41a2-a4be-fd75664ef858 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:02.660728 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-89ebf984-6f69-41a2-a4be-fd75664ef858 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:02.663200 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-89ebf984-6f69-41a2-a4be-fd75664ef858 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:02.664994 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-89ebf984-6f69-41a2-a4be-fd75664ef858 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:02.875776 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-5adede91-9bec-49c1-86e6-4fa2e799bf6f req-7a336e26-ecf5-4310-9e02-8dc5efd9e16f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86f5c96f-2d88-48b0-862e-ce27c19abfb4", "tag": "7685d4b0-825f-4ec9-b8cb-496d80179339"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:32:02.919964 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-89ebf984-6f69-41a2-a4be-fd75664ef858 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:02.932905 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-5adede91-9bec-49c1-86e6-4fa2e799bf6f req-7a336e26-ecf5-4310-9e02-8dc5efd9e16f service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:02.934545 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-89ebf984-6f69-41a2-a4be-fd75664ef858 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:02.935605 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-5adede91-9bec-49c1-86e6-4fa2e799bf6f req-7a336e26-ecf5-4310-9e02-8dc5efd9e16f service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:02.938039 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-89ebf984-6f69-41a2-a4be-fd75664ef858 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:02.942716 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-89ebf984-6f69-41a2-a4be-fd75664ef858 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1285 microversion: 2.20 time: 0.342753 Jul 28 05:32:02.963539 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 42/78] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:32:02 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1285 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:32:02.970418 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-eca3460b-c032-4297-9f7c-ff1753a15d21 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:02.971489 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-eca3460b-c032-4297-9f7c-ff1753a15d21 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:02.995006 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-eca3460b-c032-4297-9f7c-ff1753a15d21 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:02.997695 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-eca3460b-c032-4297-9f7c-ff1753a15d21 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:02.998936 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-eca3460b-c032-4297-9f7c-ff1753a15d21 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:02.999731 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-eca3460b-c032-4297-9f7c-ff1753a15d21 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:03.047001 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-5adede91-9bec-49c1-86e6-4fa2e799bf6f req-7a336e26-ecf5-4310-9e02-8dc5efd9e16f service nova] Creating event network-changed:7685d4b0-825f-4ec9-b8cb-496d80179339 for instance 86f5c96f-2d88-48b0-862e-ce27c19abfb4 on hv-cinder-79987 Jul 28 05:32:03.047819 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-5adede91-9bec-49c1-86e6-4fa2e799bf6f req-7a336e26-ecf5-4310-9e02-8dc5efd9e16f service nova] Acquired lock "compute-rpcapi-router" {{(pid=124482) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 28 05:32:03.055667 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-17c8627e-1123-4749-a00f-aad669921737 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:03.056689 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-17c8627e-1123-4749-a00f-aad669921737 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:03.059910 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-17c8627e-1123-4749-a00f-aad669921737 None None] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:03.061965 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-17c8627e-1123-4749-a00f-aad669921737 None None] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:03.078694 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.compute.rpcapi [None req-17c8627e-1123-4749-a00f-aad669921737 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 28 05:32:03.080641 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-17c8627e-1123-4749-a00f-aad669921737 None None] Releasing lock "compute-rpcapi-router" {{(pid=124482) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 28 05:32:03.099664 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-17c8627e-1123-4749-a00f-aad669921737 None None] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.545066 Jul 28 05:32:03.100810 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 37/79] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:32:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:32:03.574456 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-3b476024-9999-44bf-a550-e7dfb87a7084 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:03.576233 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-3b476024-9999-44bf-a550-e7dfb87a7084 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 86f5c96f-2d88-48b0-862e-ce27c19abfb4] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:03.608490 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3b476024-9999-44bf-a550-e7dfb87a7084 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:03.608490 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3b476024-9999-44bf-a550-e7dfb87a7084 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:03.608490 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3b476024-9999-44bf-a550-e7dfb87a7084 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:03.608490 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3b476024-9999-44bf-a550-e7dfb87a7084 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:04.511121 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-3b476024-9999-44bf-a550-e7dfb87a7084 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:04.526869 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-3b476024-9999-44bf-a550-e7dfb87a7084 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4" status: 200 len: 1322 microversion: 2.1 time: 0.956579 Jul 28 05:32:04.541636 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 38/80] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:03 2022] GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4 => generated 1322 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:32:04.569065 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-3f501f34-aeab-4d7c-9a18-756b9defee43 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:04.569065 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-3f501f34-aeab-4d7c-9a18-756b9defee43 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] [instance: 2e6d57a3-f6d1-4b5a-b313-e6cf26eec103] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:04.592892 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3f501f34-aeab-4d7c-9a18-756b9defee43 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:04.597462 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3f501f34-aeab-4d7c-9a18-756b9defee43 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:04.597462 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3f501f34-aeab-4d7c-9a18-756b9defee43 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:04.597462 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3f501f34-aeab-4d7c-9a18-756b9defee43 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:04.626292 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-eca3460b-c032-4297-9f7c-ff1753a15d21 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:04.630355 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-eca3460b-c032-4297-9f7c-ff1753a15d21 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 200 len: 1363 microversion: 2.1 time: 1.664995 Jul 28 05:32:04.630943 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 43/81] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:02 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 1363 bytes in 1667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:04.678047 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-1b34404d-8cba-432f-b8ee-a5c15544de5c tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2056642163", "imageRef": "4f0ce061-6677-4c2a-9ee1-54a100f21462", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f094ee85-e5f7-4f76-b25b-19d66faa4449"}], "security_groups": [{"name": "tempest-securitygroup--227435155"}], "key_name": "tempest-keypair-2045500188", "user_data": "}} {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:32:04.992728 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.network.neutron [None req-1b34404d-8cba-432f-b8ee-a5c15544de5c tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] validate_networks() for [('f094ee85-e5f7-4f76-b25b-19d66faa4449', None, None, None, None, None)] {{(pid=124483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 05:32:05.277145 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-3f501f34-aeab-4d7c-9a18-756b9defee43 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3124696ed4c40029066ceef822f35b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ed205b4a048e18443c6d18b871a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:05.309053 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-3f501f34-aeab-4d7c-9a18-756b9defee43 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] 10.222.0.33 "GET /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103" status: 200 len: 1315 microversion: 2.1 time: 0.765820 Jul 28 05:32:05.312479 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 39/82] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:04 2022] GET /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103 => generated 1315 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:05.319832 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-18955852-b960-4840-bb1a-515a3c777532 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:05.320855 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-18955852-b960-4840-bb1a-515a3c777532 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:05.343797 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-18955852-b960-4840-bb1a-515a3c777532 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:05.344269 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-18955852-b960-4840-bb1a-515a3c777532 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:05.345062 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-18955852-b960-4840-bb1a-515a3c777532 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:05.347292 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-18955852-b960-4840-bb1a-515a3c777532 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:05.556176 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-18955852-b960-4840-bb1a-515a3c777532 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:05.569509 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-18955852-b960-4840-bb1a-515a3c777532 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:05.571953 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-18955852-b960-4840-bb1a-515a3c777532 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:05.584505 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-18955852-b960-4840-bb1a-515a3c777532 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1333 microversion: 2.20 time: 0.270557 Jul 28 05:32:05.589493 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 40/83] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:32:05 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1333 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:32:05.605839 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-8029131f-1b6c-4a0d-a8e5-fe19d0278bed req-178714fc-8e1c-4296-b553-bcb719de986f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0539d466-3f2e-414a-8563-45ad82a3f268", "tag": "4306092c-5986-4fc4-a865-0baac79b0fbf"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:32:05.635175 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-8029131f-1b6c-4a0d-a8e5-fe19d0278bed req-178714fc-8e1c-4296-b553-bcb719de986f service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:05.635626 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-8029131f-1b6c-4a0d-a8e5-fe19d0278bed req-178714fc-8e1c-4296-b553-bcb719de986f service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:05.664295 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-8029131f-1b6c-4a0d-a8e5-fe19d0278bed req-178714fc-8e1c-4296-b553-bcb719de986f service nova] Creating event network-changed:4306092c-5986-4fc4-a865-0baac79b0fbf for instance 0539d466-3f2e-414a-8563-45ad82a3f268 on hv-cinder-79987 Jul 28 05:32:05.669532 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-8029131f-1b6c-4a0d-a8e5-fe19d0278bed req-178714fc-8e1c-4296-b553-bcb719de986f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078427 Jul 28 05:32:05.671035 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 41/84] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:32:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:32:05.677856 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-dfddcf28-c80c-4d1a-8450-c7bc3ddcb06c req-3a461af2-36e9-411d-a69e-2de6c5ba4ba8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e6d57a3-f6d1-4b5a-b313-e6cf26eec103", "tag": "dea42e8c-f00e-4206-92e3-ecad08848a56"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:32:05.689601 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-dfddcf28-c80c-4d1a-8450-c7bc3ddcb06c req-3a461af2-36e9-411d-a69e-2de6c5ba4ba8 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:05.690380 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-dfddcf28-c80c-4d1a-8450-c7bc3ddcb06c req-3a461af2-36e9-411d-a69e-2de6c5ba4ba8 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:05.706134 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-dfddcf28-c80c-4d1a-8450-c7bc3ddcb06c req-3a461af2-36e9-411d-a69e-2de6c5ba4ba8 service nova] Creating event network-changed:dea42e8c-f00e-4206-92e3-ecad08848a56 for instance 2e6d57a3-f6d1-4b5a-b313-e6cf26eec103 on hv-cinder-79987 Jul 28 05:32:05.712567 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-dfddcf28-c80c-4d1a-8450-c7bc3ddcb06c req-3a461af2-36e9-411d-a69e-2de6c5ba4ba8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039271 Jul 28 05:32:05.713619 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 42/85] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:32:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:32:05.724441 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-fd705268-4554-4d0e-900d-ba46b58f9244 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:05.728467 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-fd705268-4554-4d0e-900d-ba46b58f9244 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 86f5c96f-2d88-48b0-862e-ce27c19abfb4] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:05.745060 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-fd705268-4554-4d0e-900d-ba46b58f9244 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:05.746811 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-fd705268-4554-4d0e-900d-ba46b58f9244 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:05.747934 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-fd705268-4554-4d0e-900d-ba46b58f9244 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:05.750084 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-fd705268-4554-4d0e-900d-ba46b58f9244 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:06.250916 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG dbcounter [-] [124483] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=5 {{(pid=124483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:06.314461 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-fd705268-4554-4d0e-900d-ba46b58f9244 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:06.323172 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell1:SELECT=69 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:06.328153 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-fd705268-4554-4d0e-900d-ba46b58f9244 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4" status: 200 len: 1322 microversion: 2.1 time: 0.613145 Jul 28 05:32:06.332188 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 43/86] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:05 2022] GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4 => generated 1322 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:06.343184 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-337d11bd-5716-446d-8b6c-6b806a3314c9 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:06.345517 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-337d11bd-5716-446d-8b6c-6b806a3314c9 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:06.352967 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-337d11bd-5716-446d-8b6c-6b806a3314c9 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:06.354805 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-337d11bd-5716-446d-8b6c-6b806a3314c9 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:06.354805 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-337d11bd-5716-446d-8b6c-6b806a3314c9 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:06.356197 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-337d11bd-5716-446d-8b6c-6b806a3314c9 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:06.791772 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-337d11bd-5716-446d-8b6c-6b806a3314c9 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:06.792312 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.virt.hardware [None req-1b34404d-8cba-432f-b8ee-a5c15544de5c tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Flavor limits 0:0:0 {{(pid=124483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 05:32:06.792511 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.virt.hardware [None req-1b34404d-8cba-432f-b8ee-a5c15544de5c tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Image limits 0:0:0 {{(pid=124483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 05:32:06.793908 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-337d11bd-5716-446d-8b6c-6b806a3314c9 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 200 len: 1363 microversion: 2.1 time: 0.460257 Jul 28 05:32:06.794237 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.virt.hardware [None req-1b34404d-8cba-432f-b8ee-a5c15544de5c tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Flavor pref 0:0:0 {{(pid=124483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 05:32:06.794839 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.virt.hardware [None req-1b34404d-8cba-432f-b8ee-a5c15544de5c tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Image pref 0:0:0 {{(pid=124483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 05:32:06.795399 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.virt.hardware [None req-1b34404d-8cba-432f-b8ee-a5c15544de5c tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 05:32:06.802094 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 44/87] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:06 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 1363 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:06.805715 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-1b34404d-8cba-432f-b8ee-a5c15544de5c tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:06.807186 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-1b34404d-8cba-432f-b8ee-a5c15544de5c tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:06.807479 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-1b34404d-8cba-432f-b8ee-a5c15544de5c tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:06.808216 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-1b34404d-8cba-432f-b8ee-a5c15544de5c tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:06.813932 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-933eedc4-f684-4843-a86d-84e033e6d5b2 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:06.814563 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-933eedc4-f684-4843-a86d-84e033e6d5b2 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] [instance: 2e6d57a3-f6d1-4b5a-b313-e6cf26eec103] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:06.822968 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-933eedc4-f684-4843-a86d-84e033e6d5b2 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:06.823424 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-933eedc4-f684-4843-a86d-84e033e6d5b2 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:06.824932 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-933eedc4-f684-4843-a86d-84e033e6d5b2 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:06.825836 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-933eedc4-f684-4843-a86d-84e033e6d5b2 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:06.833515 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.quota [None req-1b34404d-8cba-432f-b8ee-a5c15544de5c tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Getting quotas for project ba0b7f7639504a25a73c94335d62b98f. Resources: {'ram', 'instances', 'cores'} {{(pid=124483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 05:32:06.839438 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.quota [None req-1b34404d-8cba-432f-b8ee-a5c15544de5c tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Getting quotas for user 0002ebbc629b4dafb109dc94450fe1d8 and project ba0b7f7639504a25a73c94335d62b98f. Resources: {'ram', 'instances', 'cores'} {{(pid=124483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 05:32:06.861260 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-1b34404d-8cba-432f-b8ee-a5c15544de5c tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Going to run 1 instances... {{(pid=124483) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 05:32:06.865558 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-1b34404d-8cba-432f-b8ee-a5c15544de5c tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: f769843b-cb4a-4599-bf54-49d579601a8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f0ce061-6677-4c2a-9ee1-54a100f21462',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 05:32:06.993044 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-933eedc4-f684-4843-a86d-84e033e6d5b2 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3124696ed4c40029066ceef822f35b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ed205b4a048e18443c6d18b871a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:07.001553 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-933eedc4-f684-4843-a86d-84e033e6d5b2 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] 10.222.0.33 "GET /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103" status: 200 len: 1315 microversion: 2.1 time: 0.198277 Jul 28 05:32:07.002756 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 45/88] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:06 2022] GET /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103 => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:07.018078 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-583bb4ed-2dca-41a3-affd-2fba9e6ec1c5 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:07.018701 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-583bb4ed-2dca-41a3-affd-2fba9e6ec1c5 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:07.025900 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-583bb4ed-2dca-41a3-affd-2fba9e6ec1c5 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:07.026540 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-583bb4ed-2dca-41a3-affd-2fba9e6ec1c5 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:07.028013 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-583bb4ed-2dca-41a3-affd-2fba9e6ec1c5 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:07.028932 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-583bb4ed-2dca-41a3-affd-2fba9e6ec1c5 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:07.055041 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-1b34404d-8cba-432f-b8ee-a5c15544de5c tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.400802 Jul 28 05:32:07.058251 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 44/89] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Jul 28 05:32:04 2022] POST /compute/v2.1/servers => generated 401 bytes in 2405 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 05:32:07.069792 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-0432e986-5ff5-4b54-b796-840d503ea2c1 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:07.070494 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-0432e986-5ff5-4b54-b796-840d503ea2c1 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: f769843b-cb4a-4599-bf54-49d579601a8a] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:07.204326 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-0432e986-5ff5-4b54-b796-840d503ea2c1 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:07.214488 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-0432e986-5ff5-4b54-b796-840d503ea2c1 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a" status: 200 len: 1242 microversion: 2.1 time: 0.149139 Jul 28 05:32:07.218552 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 45/90] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:07 2022] GET /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a => generated 1242 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:07.234879 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-583bb4ed-2dca-41a3-affd-2fba9e6ec1c5 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:07.243400 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-583bb4ed-2dca-41a3-affd-2fba9e6ec1c5 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:07.244920 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-583bb4ed-2dca-41a3-affd-2fba9e6ec1c5 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:07.246750 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-583bb4ed-2dca-41a3-affd-2fba9e6ec1c5 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1406 microversion: 2.20 time: 0.242537 Jul 28 05:32:07.247306 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 46/91] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:32:07 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1406 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:32:07.357199 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-07043b50-ce2d-480b-832a-ccfcbf3b8c45 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:07.357959 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-07043b50-ce2d-480b-832a-ccfcbf3b8c45 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 86f5c96f-2d88-48b0-862e-ce27c19abfb4] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:07.370096 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-07043b50-ce2d-480b-832a-ccfcbf3b8c45 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:07.371487 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-07043b50-ce2d-480b-832a-ccfcbf3b8c45 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:07.372586 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-07043b50-ce2d-480b-832a-ccfcbf3b8c45 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:07.373196 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-07043b50-ce2d-480b-832a-ccfcbf3b8c45 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:07.535873 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-07043b50-ce2d-480b-832a-ccfcbf3b8c45 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:07.544504 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-07043b50-ce2d-480b-832a-ccfcbf3b8c45 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4" status: 200 len: 1322 microversion: 2.1 time: 0.195667 Jul 28 05:32:07.545087 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 46/92] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:07 2022] GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4 => generated 1322 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:07.826796 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-e69a76e9-697c-447d-92e6-5f0fef1aa829 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:07.826796 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-e69a76e9-697c-447d-92e6-5f0fef1aa829 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:07.835985 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e69a76e9-697c-447d-92e6-5f0fef1aa829 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:07.836632 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e69a76e9-697c-447d-92e6-5f0fef1aa829 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:07.838912 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e69a76e9-697c-447d-92e6-5f0fef1aa829 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:07.840028 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e69a76e9-697c-447d-92e6-5f0fef1aa829 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:07.996742 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-e69a76e9-697c-447d-92e6-5f0fef1aa829 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:08.007535 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-e69a76e9-697c-447d-92e6-5f0fef1aa829 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 200 len: 1363 microversion: 2.1 time: 0.190637 Jul 28 05:32:08.008256 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 47/93] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:07 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 1363 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:08.021945 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-95a9b80f-cb14-4f1e-a07e-a93d571d6374 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:08.022790 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-95a9b80f-cb14-4f1e-a07e-a93d571d6374 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] [instance: 2e6d57a3-f6d1-4b5a-b313-e6cf26eec103] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:08.030723 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-95a9b80f-cb14-4f1e-a07e-a93d571d6374 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:08.031168 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-95a9b80f-cb14-4f1e-a07e-a93d571d6374 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:08.031928 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-95a9b80f-cb14-4f1e-a07e-a93d571d6374 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:08.037740 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-95a9b80f-cb14-4f1e-a07e-a93d571d6374 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:08.239615 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-2b852b3c-8036-463f-b405-f4f181d99250 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:08.240227 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-2b852b3c-8036-463f-b405-f4f181d99250 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: f769843b-cb4a-4599-bf54-49d579601a8a] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:08.251671 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-95a9b80f-cb14-4f1e-a07e-a93d571d6374 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3124696ed4c40029066ceef822f35b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ed205b4a048e18443c6d18b871a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:08.269887 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-95a9b80f-cb14-4f1e-a07e-a93d571d6374 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] 10.222.0.33 "GET /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103" status: 200 len: 1315 microversion: 2.1 time: 0.251886 Jul 28 05:32:08.270743 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 47/94] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:08 2022] GET /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103 => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:08.278889 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-7b738cd7-321c-4a1d-a47d-0c8f87d2521b tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:08.282053 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-7b738cd7-321c-4a1d-a47d-0c8f87d2521b tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:08.286079 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-7b738cd7-321c-4a1d-a47d-0c8f87d2521b tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:08.286624 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-7b738cd7-321c-4a1d-a47d-0c8f87d2521b tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:08.287411 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-7b738cd7-321c-4a1d-a47d-0c8f87d2521b tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:08.287868 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-7b738cd7-321c-4a1d-a47d-0c8f87d2521b tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:08.292447 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG dbcounter [-] [124483] Writing DB stats nova_cell1:SELECT=100 {{(pid=124483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:08.313196 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-2b852b3c-8036-463f-b405-f4f181d99250 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:08.319885 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell0:SELECT=39 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:08.322353 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-2b852b3c-8036-463f-b405-f4f181d99250 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a" status: 200 len: 1242 microversion: 2.1 time: 0.086689 Jul 28 05:32:08.322933 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 48/95] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:08 2022] GET /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a => generated 1242 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:32:08.448701 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-7b738cd7-321c-4a1d-a47d-0c8f87d2521b tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:08.460312 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-7b738cd7-321c-4a1d-a47d-0c8f87d2521b tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:08.462417 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-7b738cd7-321c-4a1d-a47d-0c8f87d2521b tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:08.466937 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-7b738cd7-321c-4a1d-a47d-0c8f87d2521b tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1406 microversion: 2.20 time: 0.190787 Jul 28 05:32:08.466937 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 48/96] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:32:08 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1406 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:32:08.564595 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-20f4a3a7-2dfa-4d9d-ba52-71d0bfdaeeba tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:08.565219 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-20f4a3a7-2dfa-4d9d-ba52-71d0bfdaeeba tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 86f5c96f-2d88-48b0-862e-ce27c19abfb4] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:08.573028 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-20f4a3a7-2dfa-4d9d-ba52-71d0bfdaeeba tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:08.573494 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-20f4a3a7-2dfa-4d9d-ba52-71d0bfdaeeba tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:08.574745 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-20f4a3a7-2dfa-4d9d-ba52-71d0bfdaeeba tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:08.575258 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-20f4a3a7-2dfa-4d9d-ba52-71d0bfdaeeba tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:08.727063 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-20f4a3a7-2dfa-4d9d-ba52-71d0bfdaeeba tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:08.736741 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-20f4a3a7-2dfa-4d9d-ba52-71d0bfdaeeba tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4" status: 200 len: 1322 microversion: 2.1 time: 0.176154 Jul 28 05:32:08.737315 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 49/97] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:08 2022] GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4 => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:09.037159 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-4dfc8e63-347f-456f-961d-a8131c4b5daa tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:09.038884 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-4dfc8e63-347f-456f-961d-a8131c4b5daa tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:09.047822 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-4dfc8e63-347f-456f-961d-a8131c4b5daa tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:09.049420 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-4dfc8e63-347f-456f-961d-a8131c4b5daa tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:09.050603 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-4dfc8e63-347f-456f-961d-a8131c4b5daa tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:09.051251 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-4dfc8e63-347f-456f-961d-a8131c4b5daa tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:09.293565 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-623d8837-b0d6-4405-94d0-4867ae871885 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:09.294399 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-623d8837-b0d6-4405-94d0-4867ae871885 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] [instance: 2e6d57a3-f6d1-4b5a-b313-e6cf26eec103] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:09.301057 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-623d8837-b0d6-4405-94d0-4867ae871885 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:09.301624 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-623d8837-b0d6-4405-94d0-4867ae871885 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:09.303150 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-623d8837-b0d6-4405-94d0-4867ae871885 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:09.303806 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-623d8837-b0d6-4405-94d0-4867ae871885 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:09.490687 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-4dfc8e63-347f-456f-961d-a8131c4b5daa tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:09.501240 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-4dfc8e63-347f-456f-961d-a8131c4b5daa tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 200 len: 1363 microversion: 2.1 time: 0.472125 Jul 28 05:32:09.502434 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 49/98] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:09 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 1363 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:09.507637 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-e848aa78-b85a-402d-9bdb-b5bb72bab1b7 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:09.508422 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-e848aa78-b85a-402d-9bdb-b5bb72bab1b7 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: f769843b-cb4a-4599-bf54-49d579601a8a] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:09.515194 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-e848aa78-b85a-402d-9bdb-b5bb72bab1b7 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:09.516065 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-e848aa78-b85a-402d-9bdb-b5bb72bab1b7 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:09.518085 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-e848aa78-b85a-402d-9bdb-b5bb72bab1b7 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:09.518672 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-e848aa78-b85a-402d-9bdb-b5bb72bab1b7 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:09.672358 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-e848aa78-b85a-402d-9bdb-b5bb72bab1b7 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:09.680397 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-e848aa78-b85a-402d-9bdb-b5bb72bab1b7 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a" status: 200 len: 1294 microversion: 2.1 time: 0.176593 Jul 28 05:32:09.694230 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 50/99] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:09 2022] GET /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a => generated 1294 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:09.701511 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-eee7b194-1ee6-4dba-819f-054ab7db8ba2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:09.702293 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-eee7b194-1ee6-4dba-819f-054ab7db8ba2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:09.709329 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-eee7b194-1ee6-4dba-819f-054ab7db8ba2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:09.710015 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-eee7b194-1ee6-4dba-819f-054ab7db8ba2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:09.711082 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-eee7b194-1ee6-4dba-819f-054ab7db8ba2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:09.711668 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-eee7b194-1ee6-4dba-819f-054ab7db8ba2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:09.747472 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-623d8837-b0d6-4405-94d0-4867ae871885 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3124696ed4c40029066ceef822f35b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ed205b4a048e18443c6d18b871a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:09.759738 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-623d8837-b0d6-4405-94d0-4867ae871885 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] 10.222.0.33 "GET /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103" status: 200 len: 1315 microversion: 2.1 time: 0.470578 Jul 28 05:32:09.763234 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 50/100] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:09 2022] GET /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103 => generated 1315 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:09.788099 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-9bcbde2a-f14c-4359-80cb-db4c3112ab91 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:09.791948 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-9bcbde2a-f14c-4359-80cb-db4c3112ab91 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 86f5c96f-2d88-48b0-862e-ce27c19abfb4] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:09.796939 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9bcbde2a-f14c-4359-80cb-db4c3112ab91 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:09.799245 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9bcbde2a-f14c-4359-80cb-db4c3112ab91 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:09.800277 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9bcbde2a-f14c-4359-80cb-db4c3112ab91 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:09.800967 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9bcbde2a-f14c-4359-80cb-db4c3112ab91 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:10.302262 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-eee7b194-1ee6-4dba-819f-054ab7db8ba2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:10.313775 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-eee7b194-1ee6-4dba-819f-054ab7db8ba2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:10.315826 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-eee7b194-1ee6-4dba-819f-054ab7db8ba2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:10.317029 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-eee7b194-1ee6-4dba-819f-054ab7db8ba2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1406 microversion: 2.20 time: 0.621363 Jul 28 05:32:10.317996 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 51/101] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:32:09 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1406 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:32:10.322593 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [req-d3954ad8-1d4d-4b0f-8c46-fd2499d772c6 req-6bf41561-d355-4155-8956-03f0fc20c045 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57115a26-af82-499e-a831-4b4c40e60ac5", "tag": "968687ce-4c57-4729-84c6-548124c4123e"}]} {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:32:10.334961 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [req-d3954ad8-1d4d-4b0f-8c46-fd2499d772c6 req-6bf41561-d355-4155-8956-03f0fc20c045 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:10.335415 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [req-d3954ad8-1d4d-4b0f-8c46-fd2499d772c6 req-6bf41561-d355-4155-8956-03f0fc20c045 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:10.336112 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-9bcbde2a-f14c-4359-80cb-db4c3112ab91 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:10.345008 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-9bcbde2a-f14c-4359-80cb-db4c3112ab91 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4" status: 200 len: 1322 microversion: 2.1 time: 0.583466 Jul 28 05:32:10.345607 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 51/102] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:09 2022] GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4 => generated 1322 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:10.349144 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.compute.server_external_events [req-d3954ad8-1d4d-4b0f-8c46-fd2499d772c6 req-6bf41561-d355-4155-8956-03f0fc20c045 service nova] Creating event network-changed:968687ce-4c57-4729-84c6-548124c4123e for instance 57115a26-af82-499e-a831-4b4c40e60ac5 on hv-cinder-79987 Jul 28 05:32:10.354594 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [req-d3954ad8-1d4d-4b0f-8c46-fd2499d772c6 req-6bf41561-d355-4155-8956-03f0fc20c045 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035382 Jul 28 05:32:10.355239 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 52/103] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:32:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:32:10.524206 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-87d9adff-c427-4639-92a2-d65f44bfca4b tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:10.524206 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-87d9adff-c427-4639-92a2-d65f44bfca4b tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:10.531848 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-87d9adff-c427-4639-92a2-d65f44bfca4b tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:10.532287 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-87d9adff-c427-4639-92a2-d65f44bfca4b tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:10.533046 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-87d9adff-c427-4639-92a2-d65f44bfca4b tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:10.533498 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-87d9adff-c427-4639-92a2-d65f44bfca4b tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:10.708292 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-4aa5c2f1-c7eb-4126-b4a8-94ff6538bf19 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:10.709072 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-4aa5c2f1-c7eb-4126-b4a8-94ff6538bf19 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: f769843b-cb4a-4599-bf54-49d579601a8a] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:10.724513 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-4aa5c2f1-c7eb-4126-b4a8-94ff6538bf19 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:10.725675 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-4aa5c2f1-c7eb-4126-b4a8-94ff6538bf19 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:10.727763 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-4aa5c2f1-c7eb-4126-b4a8-94ff6538bf19 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:10.729004 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-4aa5c2f1-c7eb-4126-b4a8-94ff6538bf19 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:10.860949 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-4aa5c2f1-c7eb-4126-b4a8-94ff6538bf19 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:10.867655 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-87d9adff-c427-4639-92a2-d65f44bfca4b tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:10.877343 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-4aa5c2f1-c7eb-4126-b4a8-94ff6538bf19 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a" status: 200 len: 1294 microversion: 2.1 time: 0.172750 Jul 28 05:32:10.882678 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-87d9adff-c427-4639-92a2-d65f44bfca4b tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 200 len: 1363 microversion: 2.1 time: 0.363473 Jul 28 05:32:10.883443 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 52/104] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:10 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 1363 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:10.903519 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 53/105] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:10 2022] GET /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a => generated 1294 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:32:10.903643 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-19849931-be7d-437e-a773-46e979d95045 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:10.904362 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-19849931-be7d-437e-a773-46e979d95045 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] [instance: 2e6d57a3-f6d1-4b5a-b313-e6cf26eec103] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:10.910495 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-19849931-be7d-437e-a773-46e979d95045 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:10.911171 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-19849931-be7d-437e-a773-46e979d95045 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:10.912111 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-19849931-be7d-437e-a773-46e979d95045 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:10.912717 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-19849931-be7d-437e-a773-46e979d95045 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:11.300847 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-19849931-be7d-437e-a773-46e979d95045 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3124696ed4c40029066ceef822f35b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ed205b4a048e18443c6d18b871a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:11.312150 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-19849931-be7d-437e-a773-46e979d95045 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] 10.222.0.33 "GET /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103" status: 200 len: 1315 microversion: 2.1 time: 0.414305 Jul 28 05:32:11.325511 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 53/106] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:10 2022] GET /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103 => generated 1315 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:11.341222 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-8126ffbf-d80e-407e-89ca-25fb1c2a8593 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:11.341924 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-8126ffbf-d80e-407e-89ca-25fb1c2a8593 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:11.348931 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-8126ffbf-d80e-407e-89ca-25fb1c2a8593 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:11.352299 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-8126ffbf-d80e-407e-89ca-25fb1c2a8593 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:11.352299 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-8126ffbf-d80e-407e-89ca-25fb1c2a8593 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:11.352299 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-8126ffbf-d80e-407e-89ca-25fb1c2a8593 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:11.366847 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-4a6ad68c-a7fd-45ec-bfe7-939b16989a2f tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:11.367457 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-4a6ad68c-a7fd-45ec-bfe7-939b16989a2f tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 86f5c96f-2d88-48b0-862e-ce27c19abfb4] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:11.383347 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4a6ad68c-a7fd-45ec-bfe7-939b16989a2f tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:11.383792 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4a6ad68c-a7fd-45ec-bfe7-939b16989a2f tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:11.384935 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4a6ad68c-a7fd-45ec-bfe7-939b16989a2f tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:11.385373 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4a6ad68c-a7fd-45ec-bfe7-939b16989a2f tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:11.840447 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-4a6ad68c-a7fd-45ec-bfe7-939b16989a2f tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:11.849271 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-4a6ad68c-a7fd-45ec-bfe7-939b16989a2f tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4" status: 200 len: 1322 microversion: 2.1 time: 0.486631 Jul 28 05:32:11.863771 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 54/107] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:11 2022] GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4 => generated 1322 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:11.913844 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-5c58252c-ac2a-400d-b4c1-d1872b69be90 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:11.914698 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-5c58252c-ac2a-400d-b4c1-d1872b69be90 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: f769843b-cb4a-4599-bf54-49d579601a8a] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:11.930615 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-8126ffbf-d80e-407e-89ca-25fb1c2a8593 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:11.940545 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5c58252c-ac2a-400d-b4c1-d1872b69be90 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:11.942290 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5c58252c-ac2a-400d-b4c1-d1872b69be90 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:11.943609 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5c58252c-ac2a-400d-b4c1-d1872b69be90 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:11.943744 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-8126ffbf-d80e-407e-89ca-25fb1c2a8593 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:11.945186 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-8126ffbf-d80e-407e-89ca-25fb1c2a8593 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:11.945874 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5c58252c-ac2a-400d-b4c1-d1872b69be90 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:11.951315 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-8126ffbf-d80e-407e-89ca-25fb1c2a8593 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1406 microversion: 2.20 time: 0.614870 Jul 28 05:32:11.953537 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 54/108] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:32:11 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1406 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:32:11.962733 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-1636c426-49c1-49c1-b329-2484d3e91664 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:11.966281 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-1636c426-49c1-49c1-b329-2484d3e91664 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:11.978444 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-1636c426-49c1-49c1-b329-2484d3e91664 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:11.978896 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-1636c426-49c1-49c1-b329-2484d3e91664 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:11.979663 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-1636c426-49c1-49c1-b329-2484d3e91664 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:11.985343 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-1636c426-49c1-49c1-b329-2484d3e91664 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:12.112483 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-5c58252c-ac2a-400d-b4c1-d1872b69be90 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:12.127626 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-5c58252c-ac2a-400d-b4c1-d1872b69be90 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a" status: 200 len: 1300 microversion: 2.1 time: 0.230268 Jul 28 05:32:12.142482 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 55/109] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:11 2022] GET /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a => generated 1300 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:12.269626 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-1636c426-49c1-49c1-b329-2484d3e91664 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:12.285597 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-1636c426-49c1-49c1-b329-2484d3e91664 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 200 len: 1363 microversion: 2.1 time: 0.329940 Jul 28 05:32:12.286502 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 55/110] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:11 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 1363 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:12.338554 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-73f97761-63b9-444c-acf0-f1015c89c3b1 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:12.340022 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-73f97761-63b9-444c-acf0-f1015c89c3b1 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] [instance: 2e6d57a3-f6d1-4b5a-b313-e6cf26eec103] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:12.346600 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-73f97761-63b9-444c-acf0-f1015c89c3b1 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:12.349415 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-73f97761-63b9-444c-acf0-f1015c89c3b1 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:12.351191 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-73f97761-63b9-444c-acf0-f1015c89c3b1 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:12.351969 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-73f97761-63b9-444c-acf0-f1015c89c3b1 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:12.823426 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-73f97761-63b9-444c-acf0-f1015c89c3b1 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3124696ed4c40029066ceef822f35b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ed205b4a048e18443c6d18b871a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:12.832231 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-73f97761-63b9-444c-acf0-f1015c89c3b1 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] 10.222.0.33 "GET /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103" status: 200 len: 1315 microversion: 2.1 time: 0.497657 Jul 28 05:32:12.835344 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 56/111] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:12 2022] GET /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103 => generated 1315 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:12.871239 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-397f6ca4-55bb-41f9-b602-d37a60d05411 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:12.871887 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-397f6ca4-55bb-41f9-b602-d37a60d05411 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 86f5c96f-2d88-48b0-862e-ce27c19abfb4] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:12.878984 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-397f6ca4-55bb-41f9-b602-d37a60d05411 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:12.880171 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-397f6ca4-55bb-41f9-b602-d37a60d05411 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:12.882314 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-397f6ca4-55bb-41f9-b602-d37a60d05411 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:12.883006 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-397f6ca4-55bb-41f9-b602-d37a60d05411 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:12.976437 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-d4a06251-f367-4b77-894c-afff94a573df tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:12.977053 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-d4a06251-f367-4b77-894c-afff94a573df tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:12.988279 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d4a06251-f367-4b77-894c-afff94a573df tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:12.988725 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d4a06251-f367-4b77-894c-afff94a573df tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:12.993173 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d4a06251-f367-4b77-894c-afff94a573df tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:12.993173 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d4a06251-f367-4b77-894c-afff94a573df tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:13.078590 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell0:SELECT=4 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:13.200354 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-397f6ca4-55bb-41f9-b602-d37a60d05411 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:13.210740 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-397f6ca4-55bb-41f9-b602-d37a60d05411 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4" status: 200 len: 1322 microversion: 2.1 time: 0.341220 Jul 28 05:32:13.210740 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 56/112] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:12 2022] GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4 => generated 1322 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:13.225980 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-b30514c9-d399-4847-85e6-a05574922cd4 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:13.226848 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-b30514c9-d399-4847-85e6-a05574922cd4 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: f769843b-cb4a-4599-bf54-49d579601a8a] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:13.238649 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-b30514c9-d399-4847-85e6-a05574922cd4 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:13.239215 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-b30514c9-d399-4847-85e6-a05574922cd4 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:13.240406 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-b30514c9-d399-4847-85e6-a05574922cd4 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:13.241007 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-b30514c9-d399-4847-85e6-a05574922cd4 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:13.261107 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-d4a06251-f367-4b77-894c-afff94a573df tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:13.285830 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-d4a06251-f367-4b77-894c-afff94a573df tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:13.287861 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-d4a06251-f367-4b77-894c-afff94a573df tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:13.288504 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-d4a06251-f367-4b77-894c-afff94a573df tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1406 microversion: 2.20 time: 0.316494 Jul 28 05:32:13.299009 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 57/113] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:32:12 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1406 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 05:32:13.320766 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-e565e2dd-5765-4959-902c-f7ed3a955623 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:13.325275 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-e565e2dd-5765-4959-902c-f7ed3a955623 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:13.333600 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e565e2dd-5765-4959-902c-f7ed3a955623 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:13.334060 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e565e2dd-5765-4959-902c-f7ed3a955623 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:13.336985 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e565e2dd-5765-4959-902c-f7ed3a955623 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:13.338809 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e565e2dd-5765-4959-902c-f7ed3a955623 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:13.612774 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-b30514c9-d399-4847-85e6-a05574922cd4 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:13.626637 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-b30514c9-d399-4847-85e6-a05574922cd4 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a" status: 200 len: 1367 microversion: 2.1 time: 0.415253 Jul 28 05:32:13.628394 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 57/114] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:13 2022] GET /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a => generated 1367 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:13.710682 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-e565e2dd-5765-4959-902c-f7ed3a955623 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:13.725036 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-e565e2dd-5765-4959-902c-f7ed3a955623 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 200 len: 1363 microversion: 2.1 time: 0.408630 Jul 28 05:32:13.729908 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 58/115] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:13 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 1363 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:13.859109 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-0f1ac8cf-3e8a-4aa6-8126-4b4ea58e5202 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:13.859832 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-0f1ac8cf-3e8a-4aa6-8126-4b4ea58e5202 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] [instance: 2e6d57a3-f6d1-4b5a-b313-e6cf26eec103] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:13.872804 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-0f1ac8cf-3e8a-4aa6-8126-4b4ea58e5202 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:13.873660 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-0f1ac8cf-3e8a-4aa6-8126-4b4ea58e5202 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:13.874882 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-0f1ac8cf-3e8a-4aa6-8126-4b4ea58e5202 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:13.876540 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-0f1ac8cf-3e8a-4aa6-8126-4b4ea58e5202 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:14.177557 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-0f1ac8cf-3e8a-4aa6-8126-4b4ea58e5202 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3124696ed4c40029066ceef822f35b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ed205b4a048e18443c6d18b871a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:14.187958 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-0f1ac8cf-3e8a-4aa6-8126-4b4ea58e5202 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] 10.222.0.33 "GET /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103" status: 200 len: 1315 microversion: 2.1 time: 0.335269 Jul 28 05:32:14.188560 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 58/116] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:13 2022] GET /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103 => generated 1315 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:14.232288 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-c1a46e5c-a818-4271-9634-5645c677a1bb tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:14.239060 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-c1a46e5c-a818-4271-9634-5645c677a1bb tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 86f5c96f-2d88-48b0-862e-ce27c19abfb4] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:14.244884 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c1a46e5c-a818-4271-9634-5645c677a1bb tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:14.245340 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c1a46e5c-a818-4271-9634-5645c677a1bb tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:14.246200 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c1a46e5c-a818-4271-9634-5645c677a1bb tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:14.247832 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c1a46e5c-a818-4271-9634-5645c677a1bb tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:14.329948 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-6bcf635f-1566-4bae-a72c-d94813f8de22 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:14.331482 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-6bcf635f-1566-4bae-a72c-d94813f8de22 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:14.337936 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-6bcf635f-1566-4bae-a72c-d94813f8de22 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:14.338586 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-6bcf635f-1566-4bae-a72c-d94813f8de22 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:14.340653 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-6bcf635f-1566-4bae-a72c-d94813f8de22 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:14.341389 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-6bcf635f-1566-4bae-a72c-d94813f8de22 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:14.633922 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-c1a46e5c-a818-4271-9634-5645c677a1bb tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:14.643551 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-c1a46e5c-a818-4271-9634-5645c677a1bb tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4" status: 200 len: 1322 microversion: 2.1 time: 0.415782 Jul 28 05:32:14.658782 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 59/117] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:14 2022] GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4 => generated 1322 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:14.664889 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-6e6dbf18-3e62-42d5-b274-36d8ce0dfd35 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:14.665833 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-6e6dbf18-3e62-42d5-b274-36d8ce0dfd35 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: f769843b-cb4a-4599-bf54-49d579601a8a] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:14.673953 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-6e6dbf18-3e62-42d5-b274-36d8ce0dfd35 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:14.674542 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-6e6dbf18-3e62-42d5-b274-36d8ce0dfd35 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:14.675313 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-6e6dbf18-3e62-42d5-b274-36d8ce0dfd35 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:14.675746 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-6e6dbf18-3e62-42d5-b274-36d8ce0dfd35 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:14.684758 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-6bcf635f-1566-4bae-a72c-d94813f8de22 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:14.696864 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-6bcf635f-1566-4bae-a72c-d94813f8de22 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:14.699594 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-6bcf635f-1566-4bae-a72c-d94813f8de22 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:14.712718 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-6bcf635f-1566-4bae-a72c-d94813f8de22 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1406 microversion: 2.20 time: 0.377869 Jul 28 05:32:14.724971 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 59/118] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:32:14 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1406 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 05:32:14.748328 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-36414b32-2b43-481d-bc79-78f16ab7903e tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:14.749104 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-36414b32-2b43-481d-bc79-78f16ab7903e tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:14.756950 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-36414b32-2b43-481d-bc79-78f16ab7903e tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:14.757405 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-36414b32-2b43-481d-bc79-78f16ab7903e tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:14.758210 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-36414b32-2b43-481d-bc79-78f16ab7903e tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:14.758643 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-36414b32-2b43-481d-bc79-78f16ab7903e tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:14.969319 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-6e6dbf18-3e62-42d5-b274-36d8ce0dfd35 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:14.978024 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-6e6dbf18-3e62-42d5-b274-36d8ce0dfd35 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a" status: 200 len: 1367 microversion: 2.1 time: 0.317486 Jul 28 05:32:14.978603 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 60/119] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:14 2022] GET /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a => generated 1367 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:15.028472 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-b12a3e24-46e7-4b0e-a5af-28972f45d51f req-6fa556e2-ffb3-42a5-b640-9235e3c86612 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f769843b-cb4a-4599-bf54-49d579601a8a", "tag": "b006268e-0b66-4d7e-8674-41ac5075555d"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:32:15.050848 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-b12a3e24-46e7-4b0e-a5af-28972f45d51f req-6fa556e2-ffb3-42a5-b640-9235e3c86612 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:15.051560 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-b12a3e24-46e7-4b0e-a5af-28972f45d51f req-6fa556e2-ffb3-42a5-b640-9235e3c86612 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:15.056307 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-36414b32-2b43-481d-bc79-78f16ab7903e tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:15.067215 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-36414b32-2b43-481d-bc79-78f16ab7903e tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 200 len: 1363 microversion: 2.1 time: 0.323425 Jul 28 05:32:15.068635 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 60/120] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:14 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 1363 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:15.082516 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-b12a3e24-46e7-4b0e-a5af-28972f45d51f req-6fa556e2-ffb3-42a5-b640-9235e3c86612 service nova] Creating event network-changed:b006268e-0b66-4d7e-8674-41ac5075555d for instance f769843b-cb4a-4599-bf54-49d579601a8a on hv-cinder-79987 Jul 28 05:32:15.096196 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-b12a3e24-46e7-4b0e-a5af-28972f45d51f req-6fa556e2-ffb3-42a5-b640-9235e3c86612 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070976 Jul 28 05:32:15.096196 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 61/121] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:32:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 05:32:15.227034 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-0762a494-2e8e-4984-a0eb-83e3bd8c4167 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:15.232369 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-0762a494-2e8e-4984-a0eb-83e3bd8c4167 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] [instance: 2e6d57a3-f6d1-4b5a-b313-e6cf26eec103] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:15.243691 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-0762a494-2e8e-4984-a0eb-83e3bd8c4167 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:15.243691 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-0762a494-2e8e-4984-a0eb-83e3bd8c4167 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:15.243691 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-0762a494-2e8e-4984-a0eb-83e3bd8c4167 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:15.244799 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-0762a494-2e8e-4984-a0eb-83e3bd8c4167 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:15.454125 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-0762a494-2e8e-4984-a0eb-83e3bd8c4167 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3124696ed4c40029066ceef822f35b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ed205b4a048e18443c6d18b871a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:15.462760 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-0762a494-2e8e-4984-a0eb-83e3bd8c4167 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] 10.222.0.33 "GET /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103" status: 200 len: 1315 microversion: 2.1 time: 0.251287 Jul 28 05:32:15.467960 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 61/122] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:15 2022] GET /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103 => generated 1315 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:15.668951 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-737affc7-65d0-42a1-b08b-c5e3f012a074 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:15.669685 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-737affc7-65d0-42a1-b08b-c5e3f012a074 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 86f5c96f-2d88-48b0-862e-ce27c19abfb4] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:15.679701 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-737affc7-65d0-42a1-b08b-c5e3f012a074 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:15.680405 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-737affc7-65d0-42a1-b08b-c5e3f012a074 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:15.681326 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-737affc7-65d0-42a1-b08b-c5e3f012a074 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:15.681924 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-737affc7-65d0-42a1-b08b-c5e3f012a074 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:15.711936 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell1:SELECT=100 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:15.736152 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-6ea5d51f-51ad-4629-a57a-81e59e4da950 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:15.737074 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-6ea5d51f-51ad-4629-a57a-81e59e4da950 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:15.743567 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-6ea5d51f-51ad-4629-a57a-81e59e4da950 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:15.744204 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-6ea5d51f-51ad-4629-a57a-81e59e4da950 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:15.744978 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-6ea5d51f-51ad-4629-a57a-81e59e4da950 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:15.745498 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-6ea5d51f-51ad-4629-a57a-81e59e4da950 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:16.003784 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-737affc7-65d0-42a1-b08b-c5e3f012a074 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:16.013221 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-737affc7-65d0-42a1-b08b-c5e3f012a074 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4" status: 200 len: 1322 microversion: 2.1 time: 0.352593 Jul 28 05:32:16.016082 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 62/123] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:15 2022] GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4 => generated 1322 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:16.020993 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-3a871146-951f-4f9d-84d8-0be72928a4d7 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:16.021639 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-3a871146-951f-4f9d-84d8-0be72928a4d7 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: f769843b-cb4a-4599-bf54-49d579601a8a] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:16.029437 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3a871146-951f-4f9d-84d8-0be72928a4d7 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:16.029993 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3a871146-951f-4f9d-84d8-0be72928a4d7 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:16.030839 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3a871146-951f-4f9d-84d8-0be72928a4d7 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:16.031350 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3a871146-951f-4f9d-84d8-0be72928a4d7 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:16.043764 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-6ea5d51f-51ad-4629-a57a-81e59e4da950 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:16.053879 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-6ea5d51f-51ad-4629-a57a-81e59e4da950 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:16.060943 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-6ea5d51f-51ad-4629-a57a-81e59e4da950 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:16.063940 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-6ea5d51f-51ad-4629-a57a-81e59e4da950 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1406 microversion: 2.20 time: 0.330877 Jul 28 05:32:16.065736 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 62/124] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:32:15 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1406 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 05:32:16.088698 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-ede5425e-6169-401b-a48c-eef812c68462 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:16.090166 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-ede5425e-6169-401b-a48c-eef812c68462 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:16.096398 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-ede5425e-6169-401b-a48c-eef812c68462 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:16.096959 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-ede5425e-6169-401b-a48c-eef812c68462 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:16.097955 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-ede5425e-6169-401b-a48c-eef812c68462 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:16.098952 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-ede5425e-6169-401b-a48c-eef812c68462 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:16.332650 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-3a871146-951f-4f9d-84d8-0be72928a4d7 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:16.344458 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-3a871146-951f-4f9d-84d8-0be72928a4d7 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a" status: 200 len: 1367 microversion: 2.1 time: 0.327090 Jul 28 05:32:16.347719 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 63/125] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:16 2022] GET /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a => generated 1367 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:16.418515 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-ede5425e-6169-401b-a48c-eef812c68462 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:16.433802 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-ede5425e-6169-401b-a48c-eef812c68462 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 200 len: 1363 microversion: 2.1 time: 0.348452 Jul 28 05:32:16.436640 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 63/126] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:16 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 1363 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:32:16.463460 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-579bb512-3133-4c0d-a05a-b419befba6de req-06c47ecf-2897-4e02-88e9-f0f94b8f01fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d70d71f4-de27-4d62-acad-c6e9a7a7225e", "name": "network-vif-plugged", "status": "completed", "tag": "c16cb5d0-7376-4ff8-92fe-2ea79594b837"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:32:16.474741 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-579bb512-3133-4c0d-a05a-b419befba6de req-06c47ecf-2897-4e02-88e9-f0f94b8f01fc service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:16.475363 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-579bb512-3133-4c0d-a05a-b419befba6de req-06c47ecf-2897-4e02-88e9-f0f94b8f01fc service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:16.488530 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-648e14c4-6889-466f-aff0-d4b2053b026c tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:16.489364 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-648e14c4-6889-466f-aff0-d4b2053b026c tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] [instance: 2e6d57a3-f6d1-4b5a-b313-e6cf26eec103] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:16.494315 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-579bb512-3133-4c0d-a05a-b419befba6de req-06c47ecf-2897-4e02-88e9-f0f94b8f01fc service nova] Creating event network-vif-plugged:c16cb5d0-7376-4ff8-92fe-2ea79594b837 for instance d70d71f4-de27-4d62-acad-c6e9a7a7225e on hv-cinder-79987 Jul 28 05:32:16.496566 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-648e14c4-6889-466f-aff0-d4b2053b026c tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:16.497019 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-648e14c4-6889-466f-aff0-d4b2053b026c tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:16.497885 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-648e14c4-6889-466f-aff0-d4b2053b026c tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:16.498321 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-648e14c4-6889-466f-aff0-d4b2053b026c tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:16.502978 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-579bb512-3133-4c0d-a05a-b419befba6de req-06c47ecf-2897-4e02-88e9-f0f94b8f01fc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140393 Jul 28 05:32:16.503747 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 64/127] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:32:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:32:16.662305 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-648e14c4-6889-466f-aff0-d4b2053b026c tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3124696ed4c40029066ceef822f35b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ed205b4a048e18443c6d18b871a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:16.673821 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-648e14c4-6889-466f-aff0-d4b2053b026c tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] 10.222.0.33 "GET /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103" status: 200 len: 1315 microversion: 2.1 time: 0.189067 Jul 28 05:32:16.674416 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 64/128] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:16 2022] GET /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103 => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:32:17.038426 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-d8624cde-cc37-4c9b-8c2b-ab682c61ed21 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:17.039185 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-d8624cde-cc37-4c9b-8c2b-ab682c61ed21 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 86f5c96f-2d88-48b0-862e-ce27c19abfb4] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:17.046607 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d8624cde-cc37-4c9b-8c2b-ab682c61ed21 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:17.047055 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d8624cde-cc37-4c9b-8c2b-ab682c61ed21 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:17.049935 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d8624cde-cc37-4c9b-8c2b-ab682c61ed21 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:17.051027 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d8624cde-cc37-4c9b-8c2b-ab682c61ed21 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:17.087652 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-574bb440-594b-4753-9d95-7cd8cd6657b2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:17.088258 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-574bb440-594b-4753-9d95-7cd8cd6657b2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:17.090365 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG dbcounter [-] [124483] Writing DB stats nova_cell0:SELECT=4 {{(pid=124483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:17.095495 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-574bb440-594b-4753-9d95-7cd8cd6657b2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:17.095941 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-574bb440-594b-4753-9d95-7cd8cd6657b2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:17.096885 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-574bb440-594b-4753-9d95-7cd8cd6657b2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:17.097734 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-574bb440-594b-4753-9d95-7cd8cd6657b2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:17.116845 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG dbcounter [-] [124483] Writing DB stats nova_cell1:SELECT=100 {{(pid=124483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:17.210072 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG dbcounter [-] [124483] Writing DB stats nova_cell0:SELECT=8 {{(pid=124483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:17.431483 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-d8624cde-cc37-4c9b-8c2b-ab682c61ed21 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:17.431483 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-d8624cde-cc37-4c9b-8c2b-ab682c61ed21 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4" status: 200 len: 1322 microversion: 2.1 time: 0.221220 Jul 28 05:32:17.431483 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 65/129] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:17 2022] GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4 => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:17.434778 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-574bb440-594b-4753-9d95-7cd8cd6657b2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:17.434778 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-574bb440-594b-4753-9d95-7cd8cd6657b2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:17.435122 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-574bb440-594b-4753-9d95-7cd8cd6657b2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:17.435122 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-574bb440-594b-4753-9d95-7cd8cd6657b2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1406 microversion: 2.20 time: 0.203713 Jul 28 05:32:17.435122 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 65/130] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:32:17 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1406 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 05:32:17.435338 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-33f51397-568c-4947-852d-5318ba372bfb tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:17.435338 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-33f51397-568c-4947-852d-5318ba372bfb tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: f769843b-cb4a-4599-bf54-49d579601a8a] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:17.435338 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-33f51397-568c-4947-852d-5318ba372bfb tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:17.435338 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-33f51397-568c-4947-852d-5318ba372bfb tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:17.435630 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-33f51397-568c-4947-852d-5318ba372bfb tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:17.435630 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-33f51397-568c-4947-852d-5318ba372bfb tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:17.456423 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-44114ed4-a79e-40a8-ac82-fa4fcf19d439 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:17.457059 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-44114ed4-a79e-40a8-ac82-fa4fcf19d439 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:17.463480 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-44114ed4-a79e-40a8-ac82-fa4fcf19d439 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:17.464182 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-44114ed4-a79e-40a8-ac82-fa4fcf19d439 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:17.465195 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-44114ed4-a79e-40a8-ac82-fa4fcf19d439 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:17.465654 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-44114ed4-a79e-40a8-ac82-fa4fcf19d439 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:17.535473 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-33f51397-568c-4947-852d-5318ba372bfb tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:17.544269 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-33f51397-568c-4947-852d-5318ba372bfb tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a" status: 200 len: 1367 microversion: 2.1 time: 0.180232 Jul 28 05:32:17.545343 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 66/131] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:17 2022] GET /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:17.681812 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-44114ed4-a79e-40a8-ac82-fa4fcf19d439 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:17.691501 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-44114ed4-a79e-40a8-ac82-fa4fcf19d439 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 200 len: 1363 microversion: 2.1 time: 0.238393 Jul 28 05:32:17.697525 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 66/132] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:17 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 1363 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:17.697735 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-86be2bbc-2d6b-4c8f-9447-3a8310e6011a tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:17.697735 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-86be2bbc-2d6b-4c8f-9447-3a8310e6011a tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] [instance: 2e6d57a3-f6d1-4b5a-b313-e6cf26eec103] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:17.704093 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-86be2bbc-2d6b-4c8f-9447-3a8310e6011a tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:17.704644 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-86be2bbc-2d6b-4c8f-9447-3a8310e6011a tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:17.705550 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-86be2bbc-2d6b-4c8f-9447-3a8310e6011a tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:17.706065 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-86be2bbc-2d6b-4c8f-9447-3a8310e6011a tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:17.846107 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-86be2bbc-2d6b-4c8f-9447-3a8310e6011a tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3124696ed4c40029066ceef822f35b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ed205b4a048e18443c6d18b871a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:17.854138 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-86be2bbc-2d6b-4c8f-9447-3a8310e6011a tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] 10.222.0.33 "GET /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103" status: 200 len: 1315 microversion: 2.1 time: 0.162079 Jul 28 05:32:17.855315 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 67/133] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:17 2022] GET /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:32:18.421091 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-e524fbde-d773-4f28-8e92-4a63dea54dbb tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:18.421741 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-e524fbde-d773-4f28-8e92-4a63dea54dbb tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 86f5c96f-2d88-48b0-862e-ce27c19abfb4] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:18.429912 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-3650b374-950a-43aa-b79c-eb2e182def5e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:18.431161 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-e524fbde-d773-4f28-8e92-4a63dea54dbb tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:18.431297 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-3650b374-950a-43aa-b79c-eb2e182def5e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:18.431764 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-e524fbde-d773-4f28-8e92-4a63dea54dbb tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:18.432489 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-e524fbde-d773-4f28-8e92-4a63dea54dbb tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:18.433033 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-e524fbde-d773-4f28-8e92-4a63dea54dbb tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:18.438497 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3650b374-950a-43aa-b79c-eb2e182def5e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:18.439503 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3650b374-950a-43aa-b79c-eb2e182def5e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:18.440564 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3650b374-950a-43aa-b79c-eb2e182def5e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:18.441217 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3650b374-950a-43aa-b79c-eb2e182def5e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:18.690409 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell0:SELECT=1 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:18.846634 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-e524fbde-d773-4f28-8e92-4a63dea54dbb tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:18.850205 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-3650b374-950a-43aa-b79c-eb2e182def5e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:18.854453 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-e524fbde-d773-4f28-8e92-4a63dea54dbb tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4" status: 200 len: 1322 microversion: 2.1 time: 0.438176 Jul 28 05:32:18.855590 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 67/134] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:18 2022] GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4 => generated 1322 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:18.859034 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-3650b374-950a-43aa-b79c-eb2e182def5e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:18.860209 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [req-f4c0449f-0f75-4cd4-83ba-e054529857e6 req-6dc82f73-31d6-4db5-ad37-3c6e0064e3cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86f5c96f-2d88-48b0-862e-ce27c19abfb4", "name": "network-vif-plugged", "status": "completed", "tag": "7685d4b0-825f-4ec9-b8cb-496d80179339"}, {"server_uuid": "2e6d57a3-f6d1-4b5a-b313-e6cf26eec103", "name": "network-vif-plugged", "status": "completed", "tag": "dea42e8c-f00e-4206-92e3-ecad08848a56"}, {"server_uuid": "0539d466-3f2e-414a-8563-45ad82a3f268", "name": "network-vif-plugged", "status": "completed", "tag": "4306092c-5986-4fc4-a865-0baac79b0fbf"}, {"server_uuid": "57115a26-af82-499e-a831-4b4c40e60ac5", "name": "network-vif-plugged", "status": "completed", "tag": "968687ce-4c57-4729-84c6-548124c4123e"}]} {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:32:18.860531 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-3650b374-950a-43aa-b79c-eb2e182def5e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:18.861726 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-3650b374-950a-43aa-b79c-eb2e182def5e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1406 microversion: 2.20 time: 0.435993 Jul 28 05:32:18.862444 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 68/135] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:32:18 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1406 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 05:32:18.867033 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-7f61bf4d-c33b-4870-b063-64650fbfd4fb tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:18.867828 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-7f61bf4d-c33b-4870-b063-64650fbfd4fb tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: f769843b-cb4a-4599-bf54-49d579601a8a] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:18.877227 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7f61bf4d-c33b-4870-b063-64650fbfd4fb tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:18.877710 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7f61bf4d-c33b-4870-b063-64650fbfd4fb tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:18.882946 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [req-f4c0449f-0f75-4cd4-83ba-e054529857e6 req-6dc82f73-31d6-4db5-ad37-3c6e0064e3cf service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:18.883081 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7f61bf4d-c33b-4870-b063-64650fbfd4fb tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:18.883161 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [req-f4c0449f-0f75-4cd4-83ba-e054529857e6 req-6dc82f73-31d6-4db5-ad37-3c6e0064e3cf service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:18.883239 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7f61bf4d-c33b-4870-b063-64650fbfd4fb tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:18.895068 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.compute.server_external_events [req-f4c0449f-0f75-4cd4-83ba-e054529857e6 req-6dc82f73-31d6-4db5-ad37-3c6e0064e3cf service nova] Creating event network-vif-plugged:7685d4b0-825f-4ec9-b8cb-496d80179339 for instance 86f5c96f-2d88-48b0-862e-ce27c19abfb4 on hv-cinder-79987 Jul 28 05:32:18.895619 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.compute.server_external_events [req-f4c0449f-0f75-4cd4-83ba-e054529857e6 req-6dc82f73-31d6-4db5-ad37-3c6e0064e3cf service nova] Creating event network-vif-plugged:dea42e8c-f00e-4206-92e3-ecad08848a56 for instance 2e6d57a3-f6d1-4b5a-b313-e6cf26eec103 on hv-cinder-79987 Jul 28 05:32:18.896175 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.compute.server_external_events [req-f4c0449f-0f75-4cd4-83ba-e054529857e6 req-6dc82f73-31d6-4db5-ad37-3c6e0064e3cf service nova] Creating event network-vif-plugged:4306092c-5986-4fc4-a865-0baac79b0fbf for instance 0539d466-3f2e-414a-8563-45ad82a3f268 on hv-cinder-79987 Jul 28 05:32:18.896630 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.compute.server_external_events [req-f4c0449f-0f75-4cd4-83ba-e054529857e6 req-6dc82f73-31d6-4db5-ad37-3c6e0064e3cf service nova] Creating event network-vif-plugged:968687ce-4c57-4729-84c6-548124c4123e for instance 57115a26-af82-499e-a831-4b4c40e60ac5 on hv-cinder-79987 Jul 28 05:32:18.910290 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [req-f4c0449f-0f75-4cd4-83ba-e054529857e6 req-6dc82f73-31d6-4db5-ad37-3c6e0064e3cf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.053401 Jul 28 05:32:18.911204 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 68/136] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:32:18 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:32:18.916600 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-740fcc17-b0cf-4225-84d1-1b96807fd59c tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:18.918031 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-740fcc17-b0cf-4225-84d1-1b96807fd59c tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:18.927180 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-740fcc17-b0cf-4225-84d1-1b96807fd59c tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:18.927683 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-740fcc17-b0cf-4225-84d1-1b96807fd59c tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:18.928548 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-740fcc17-b0cf-4225-84d1-1b96807fd59c tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:18.929053 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-740fcc17-b0cf-4225-84d1-1b96807fd59c tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:19.069123 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-7f61bf4d-c33b-4870-b063-64650fbfd4fb tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:19.081096 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-7f61bf4d-c33b-4870-b063-64650fbfd4fb tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a" status: 200 len: 1367 microversion: 2.1 time: 0.217274 Jul 28 05:32:19.082017 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 69/137] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:18 2022] GET /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:19.088036 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-a1de0c55-f793-4e1b-8695-4f90e7ef028d tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:19.090020 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-a1de0c55-f793-4e1b-8695-4f90e7ef028d tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] [instance: 2e6d57a3-f6d1-4b5a-b313-e6cf26eec103] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:19.098919 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a1de0c55-f793-4e1b-8695-4f90e7ef028d tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:19.102734 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a1de0c55-f793-4e1b-8695-4f90e7ef028d tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:19.104170 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a1de0c55-f793-4e1b-8695-4f90e7ef028d tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:19.105966 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a1de0c55-f793-4e1b-8695-4f90e7ef028d tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:19.119264 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-740fcc17-b0cf-4225-84d1-1b96807fd59c tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:19.130185 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-740fcc17-b0cf-4225-84d1-1b96807fd59c tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 200 len: 1363 microversion: 2.1 time: 0.217722 Jul 28 05:32:19.130776 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 69/138] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:18 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 1363 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:19.259396 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-a1de0c55-f793-4e1b-8695-4f90e7ef028d tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3124696ed4c40029066ceef822f35b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ed205b4a048e18443c6d18b871a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:19.273181 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-a1de0c55-f793-4e1b-8695-4f90e7ef028d tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] 10.222.0.33 "GET /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103" status: 200 len: 1315 microversion: 2.1 time: 0.189900 Jul 28 05:32:19.274802 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 70/139] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:19 2022] GET /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103 => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:19.882199 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-cf788a34-7086-49a7-97fe-638963bca292 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:19.884234 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-cf788a34-7086-49a7-97fe-638963bca292 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 86f5c96f-2d88-48b0-862e-ce27c19abfb4] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:19.886150 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-9a086d77-1017-4875-bbb7-d5ea52686c19 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:19.887192 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-9a086d77-1017-4875-bbb7-d5ea52686c19 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:19.891539 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-cf788a34-7086-49a7-97fe-638963bca292 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:19.892159 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-cf788a34-7086-49a7-97fe-638963bca292 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:19.893087 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-cf788a34-7086-49a7-97fe-638963bca292 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:19.893559 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-cf788a34-7086-49a7-97fe-638963bca292 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:19.897053 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9a086d77-1017-4875-bbb7-d5ea52686c19 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:19.898246 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9a086d77-1017-4875-bbb7-d5ea52686c19 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:19.899035 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9a086d77-1017-4875-bbb7-d5ea52686c19 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:19.899509 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9a086d77-1017-4875-bbb7-d5ea52686c19 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:20.126337 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-cf788a34-7086-49a7-97fe-638963bca292 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:20.137197 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-cf788a34-7086-49a7-97fe-638963bca292 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4" status: 200 len: 1322 microversion: 2.1 time: 0.260255 Jul 28 05:32:20.138953 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 70/140] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:19 2022] GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4 => generated 1322 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:20.142794 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-9a086d77-1017-4875-bbb7-d5ea52686c19 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:20.152902 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-9a086d77-1017-4875-bbb7-d5ea52686c19 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:20.159644 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-9a086d77-1017-4875-bbb7-d5ea52686c19 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:20.160303 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-9ad7b6ab-893e-4df4-b4eb-c6dc5893805f tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:20.161025 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-9ad7b6ab-893e-4df4-b4eb-c6dc5893805f tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: f769843b-cb4a-4599-bf54-49d579601a8a] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:20.162298 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-9a086d77-1017-4875-bbb7-d5ea52686c19 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1406 microversion: 2.20 time: 0.280980 Jul 28 05:32:20.176780 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 71/141] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:32:19 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1406 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 05:32:20.190058 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-9ad7b6ab-893e-4df4-b4eb-c6dc5893805f tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:20.191927 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-b68b4817-d3db-4b35-9b65-7faf327623d0 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:20.192669 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-9ad7b6ab-893e-4df4-b4eb-c6dc5893805f tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:20.193365 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-b68b4817-d3db-4b35-9b65-7faf327623d0 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:20.194341 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-9ad7b6ab-893e-4df4-b4eb-c6dc5893805f tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:20.198012 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-9ad7b6ab-893e-4df4-b4eb-c6dc5893805f tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:20.207982 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b68b4817-d3db-4b35-9b65-7faf327623d0 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:20.210388 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b68b4817-d3db-4b35-9b65-7faf327623d0 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:20.214597 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b68b4817-d3db-4b35-9b65-7faf327623d0 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:20.218255 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b68b4817-d3db-4b35-9b65-7faf327623d0 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:20.435593 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-b68b4817-d3db-4b35-9b65-7faf327623d0 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:20.438979 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-9ad7b6ab-893e-4df4-b4eb-c6dc5893805f tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:20.442987 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-b68b4817-d3db-4b35-9b65-7faf327623d0 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 200 len: 1363 microversion: 2.1 time: 0.264688 Jul 28 05:32:20.443566 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 72/142] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:20 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 1363 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:20.446507 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-9ad7b6ab-893e-4df4-b4eb-c6dc5893805f tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a" status: 200 len: 1367 microversion: 2.1 time: 0.292579 Jul 28 05:32:20.447128 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 71/143] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:20 2022] GET /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a => generated 1367 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:20.448180 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-2bf2d374-69d9-4ea5-81b1-a5f74d07734e tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:20.449708 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-2bf2d374-69d9-4ea5-81b1-a5f74d07734e tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] [instance: 2e6d57a3-f6d1-4b5a-b313-e6cf26eec103] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:20.456349 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2bf2d374-69d9-4ea5-81b1-a5f74d07734e tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:20.456860 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2bf2d374-69d9-4ea5-81b1-a5f74d07734e tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:20.459094 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2bf2d374-69d9-4ea5-81b1-a5f74d07734e tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:20.459094 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2bf2d374-69d9-4ea5-81b1-a5f74d07734e tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:20.602240 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-2bf2d374-69d9-4ea5-81b1-a5f74d07734e tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3124696ed4c40029066ceef822f35b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ed205b4a048e18443c6d18b871a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:20.610685 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-2bf2d374-69d9-4ea5-81b1-a5f74d07734e tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] 10.222.0.33 "GET /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103" status: 200 len: 1315 microversion: 2.1 time: 0.166114 Jul 28 05:32:20.611274 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 73/144] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:20 2022] GET /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:21.160275 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-acc87fe5-a0cd-49a6-a42d-037224db87bc tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:21.168505 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-acc87fe5-a0cd-49a6-a42d-037224db87bc tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 86f5c96f-2d88-48b0-862e-ce27c19abfb4] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:21.184117 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-acc87fe5-a0cd-49a6-a42d-037224db87bc tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:21.186047 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-acc87fe5-a0cd-49a6-a42d-037224db87bc tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:21.187287 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-acc87fe5-a0cd-49a6-a42d-037224db87bc tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:21.192850 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-fdfa5716-34ba-4928-b23a-5d1d457c60bc tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:21.194404 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-fdfa5716-34ba-4928-b23a-5d1d457c60bc tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:21.202140 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-acc87fe5-a0cd-49a6-a42d-037224db87bc tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:21.203225 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-fdfa5716-34ba-4928-b23a-5d1d457c60bc tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:21.203672 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-fdfa5716-34ba-4928-b23a-5d1d457c60bc tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:21.204664 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-fdfa5716-34ba-4928-b23a-5d1d457c60bc tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:21.205265 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-fdfa5716-34ba-4928-b23a-5d1d457c60bc tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:21.424962 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-acc87fe5-a0cd-49a6-a42d-037224db87bc tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:21.427127 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-fdfa5716-34ba-4928-b23a-5d1d457c60bc tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:21.433983 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-acc87fe5-a0cd-49a6-a42d-037224db87bc tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4" status: 200 len: 1322 microversion: 2.1 time: 0.277549 Jul 28 05:32:21.437534 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-fdfa5716-34ba-4928-b23a-5d1d457c60bc tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:21.437941 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 72/145] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:21 2022] GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4 => generated 1322 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:21.441066 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-fdfa5716-34ba-4928-b23a-5d1d457c60bc tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:21.442476 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-fdfa5716-34ba-4928-b23a-5d1d457c60bc tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1406 microversion: 2.20 time: 0.254231 Jul 28 05:32:21.447967 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 74/146] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:32:21 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1406 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 05:32:21.466462 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-0e69aea8-8f73-4c8c-8267-5f08e5084232 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:21.467117 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-0e69aea8-8f73-4c8c-8267-5f08e5084232 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:21.474830 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-2f1fdbe2-e419-456a-b714-8b1ce95ae143 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:21.475653 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-0e69aea8-8f73-4c8c-8267-5f08e5084232 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:21.475795 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-2f1fdbe2-e419-456a-b714-8b1ce95ae143 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: f769843b-cb4a-4599-bf54-49d579601a8a] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:21.476182 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-0e69aea8-8f73-4c8c-8267-5f08e5084232 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:21.476957 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-0e69aea8-8f73-4c8c-8267-5f08e5084232 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:21.477592 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-0e69aea8-8f73-4c8c-8267-5f08e5084232 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:21.483165 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2f1fdbe2-e419-456a-b714-8b1ce95ae143 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:21.483729 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2f1fdbe2-e419-456a-b714-8b1ce95ae143 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:21.484862 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2f1fdbe2-e419-456a-b714-8b1ce95ae143 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:21.485394 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2f1fdbe2-e419-456a-b714-8b1ce95ae143 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:21.695280 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-2f1fdbe2-e419-456a-b714-8b1ce95ae143 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:21.700497 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-0e69aea8-8f73-4c8c-8267-5f08e5084232 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:21.703752 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-2f1fdbe2-e419-456a-b714-8b1ce95ae143 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a" status: 200 len: 1367 microversion: 2.1 time: 0.233777 Jul 28 05:32:21.704723 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 75/147] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:21 2022] GET /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a => generated 1367 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:32:21.712173 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-0e69aea8-8f73-4c8c-8267-5f08e5084232 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 200 len: 1363 microversion: 2.1 time: 0.249986 Jul 28 05:32:21.712755 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 73/148] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:21 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 1363 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:21.714322 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-8ff1a37d-8e4b-4ee4-8967-e60e1eb4f774 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:21.714322 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-8ff1a37d-8e4b-4ee4-8967-e60e1eb4f774 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] [instance: 2e6d57a3-f6d1-4b5a-b313-e6cf26eec103] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:21.720542 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8ff1a37d-8e4b-4ee4-8967-e60e1eb4f774 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:21.720989 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8ff1a37d-8e4b-4ee4-8967-e60e1eb4f774 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:21.721798 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8ff1a37d-8e4b-4ee4-8967-e60e1eb4f774 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:21.722228 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8ff1a37d-8e4b-4ee4-8967-e60e1eb4f774 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:21.722708 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [req-5c0fb162-1537-4576-be1b-ff518ba445b9 req-8256e0b7-a78d-4c5a-8e45-134fc6e617a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f769843b-cb4a-4599-bf54-49d579601a8a", "name": "network-vif-plugged", "status": "completed", "tag": "b006268e-0b66-4d7e-8674-41ac5075555d"}]} {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:32:21.733505 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [req-5c0fb162-1537-4576-be1b-ff518ba445b9 req-8256e0b7-a78d-4c5a-8e45-134fc6e617a3 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:21.733946 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [req-5c0fb162-1537-4576-be1b-ff518ba445b9 req-8256e0b7-a78d-4c5a-8e45-134fc6e617a3 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:21.746348 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.compute.server_external_events [req-5c0fb162-1537-4576-be1b-ff518ba445b9 req-8256e0b7-a78d-4c5a-8e45-134fc6e617a3 service nova] Creating event network-vif-plugged:b006268e-0b66-4d7e-8674-41ac5075555d for instance f769843b-cb4a-4599-bf54-49d579601a8a on hv-cinder-79987 Jul 28 05:32:21.750659 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [req-5c0fb162-1537-4576-be1b-ff518ba445b9 req-8256e0b7-a78d-4c5a-8e45-134fc6e617a3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036635 Jul 28 05:32:21.751362 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 74/149] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:32:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:32:21.874818 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-8ff1a37d-8e4b-4ee4-8967-e60e1eb4f774 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3124696ed4c40029066ceef822f35b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ed205b4a048e18443c6d18b871a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:21.883085 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-8ff1a37d-8e4b-4ee4-8967-e60e1eb4f774 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] 10.222.0.33 "GET /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103" status: 200 len: 1315 microversion: 2.1 time: 0.176901 Jul 28 05:32:21.883778 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 76/150] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:21 2022] GET /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:22.456083 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-84eb5dbe-00a8-4535-9d07-cb58a85811b6 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:22.457077 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-84eb5dbe-00a8-4535-9d07-cb58a85811b6 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 86f5c96f-2d88-48b0-862e-ce27c19abfb4] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:22.465843 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-84eb5dbe-00a8-4535-9d07-cb58a85811b6 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:22.466289 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-84eb5dbe-00a8-4535-9d07-cb58a85811b6 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:22.467048 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-84eb5dbe-00a8-4535-9d07-cb58a85811b6 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:22.474320 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-84eb5dbe-00a8-4535-9d07-cb58a85811b6 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:22.474535 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-36dfdb27-2137-4c38-a936-411910142b4a tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:22.474535 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-36dfdb27-2137-4c38-a936-411910142b4a tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:22.477932 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-36dfdb27-2137-4c38-a936-411910142b4a tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:22.478391 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-36dfdb27-2137-4c38-a936-411910142b4a tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:22.479160 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-36dfdb27-2137-4c38-a936-411910142b4a tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:22.479791 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-36dfdb27-2137-4c38-a936-411910142b4a tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:22.712057 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-36dfdb27-2137-4c38-a936-411910142b4a tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:22.725293 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-84eb5dbe-00a8-4535-9d07-cb58a85811b6 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:22.736470 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-84eb5dbe-00a8-4535-9d07-cb58a85811b6 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4" status: 200 len: 1322 microversion: 2.1 time: 0.284671 Jul 28 05:32:22.738356 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 75/151] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:22 2022] GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4 => generated 1322 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:22.761621 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-36dfdb27-2137-4c38-a936-411910142b4a tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:22.761621 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-36dfdb27-2137-4c38-a936-411910142b4a tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:22.761621 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-36dfdb27-2137-4c38-a936-411910142b4a tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1598 microversion: 2.20 time: 0.275155 Jul 28 05:32:22.762433 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 77/152] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:32:22 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1598 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 05:32:22.762772 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-2d0ad249-f6cf-43a4-99d4-960007dd2113 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:22.762772 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-2d0ad249-f6cf-43a4-99d4-960007dd2113 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: f769843b-cb4a-4599-bf54-49d579601a8a] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:22.762772 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-2d0ad249-f6cf-43a4-99d4-960007dd2113 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:22.762772 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-2d0ad249-f6cf-43a4-99d4-960007dd2113 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:22.763027 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-2d0ad249-f6cf-43a4-99d4-960007dd2113 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:22.763027 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-2d0ad249-f6cf-43a4-99d4-960007dd2113 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:22.777045 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-23f1bf55-014c-45e8-aa45-d806eb5327ff tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:22.777891 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-23f1bf55-014c-45e8-aa45-d806eb5327ff tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:22.787324 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-23f1bf55-014c-45e8-aa45-d806eb5327ff tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:22.787768 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-23f1bf55-014c-45e8-aa45-d806eb5327ff tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:22.788680 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-23f1bf55-014c-45e8-aa45-d806eb5327ff tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:22.789117 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-23f1bf55-014c-45e8-aa45-d806eb5327ff tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:22.970062 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-2d0ad249-f6cf-43a4-99d4-960007dd2113 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:22.980191 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-2d0ad249-f6cf-43a4-99d4-960007dd2113 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a" status: 200 len: 1367 microversion: 2.1 time: 0.241157 Jul 28 05:32:22.980767 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 76/153] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:22 2022] GET /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a => generated 1367 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:22.987499 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-33adf9a0-2b05-4ed8-8d9a-6f6c60ef4c1a tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:22.988116 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-33adf9a0-2b05-4ed8-8d9a-6f6c60ef4c1a tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:22.989636 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-23f1bf55-014c-45e8-aa45-d806eb5327ff tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:23.004012 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-23f1bf55-014c-45e8-aa45-d806eb5327ff tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 200 len: 1549 microversion: 2.1 time: 0.259274 Jul 28 05:32:23.011743 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-33adf9a0-2b05-4ed8-8d9a-6f6c60ef4c1a tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:23.012559 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-33adf9a0-2b05-4ed8-8d9a-6f6c60ef4c1a tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:23.013562 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-33adf9a0-2b05-4ed8-8d9a-6f6c60ef4c1a tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:23.014179 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-33adf9a0-2b05-4ed8-8d9a-6f6c60ef4c1a tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:23.021142 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 78/154] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:22 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 1549 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:23.027413 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-20707646-5696-4627-b6ee-64557304cc87 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:23.032257 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-20707646-5696-4627-b6ee-64557304cc87 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] [instance: 2e6d57a3-f6d1-4b5a-b313-e6cf26eec103] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:23.034766 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-20707646-5696-4627-b6ee-64557304cc87 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:23.035383 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-20707646-5696-4627-b6ee-64557304cc87 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:23.036156 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-20707646-5696-4627-b6ee-64557304cc87 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:23.037162 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-20707646-5696-4627-b6ee-64557304cc87 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:23.063680 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell1:SELECT=100 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:23.169402 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-33adf9a0-2b05-4ed8-8d9a-6f6c60ef4c1a tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.187330 Jul 28 05:32:23.170165 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 77/155] 10.222.0.33 () {60 vars in 1316 bytes} [Thu Jul 28 05:32:22 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5/os-interface => generated 284 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 05:32:23.181968 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-cd691923-318d-4926-a2cc-daa9fc6d5976 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:23.183716 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-cd691923-318d-4926-a2cc-daa9fc6d5976 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:23.190964 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-cd691923-318d-4926-a2cc-daa9fc6d5976 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:23.191413 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-cd691923-318d-4926-a2cc-daa9fc6d5976 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:23.192228 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-cd691923-318d-4926-a2cc-daa9fc6d5976 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:23.192658 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-cd691923-318d-4926-a2cc-daa9fc6d5976 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:23.395961 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-cd691923-318d-4926-a2cc-daa9fc6d5976 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.224472 Jul 28 05:32:23.404605 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 78/156] 10.222.0.33 () {58 vars in 1275 bytes} [Thu Jul 28 05:32:23 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268/os-interface => generated 285 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:32:23.423745 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-20707646-5696-4627-b6ee-64557304cc87 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3124696ed4c40029066ceef822f35b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ed205b4a048e18443c6d18b871a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:23.435165 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-20707646-5696-4627-b6ee-64557304cc87 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] 10.222.0.33 "GET /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103" status: 200 len: 1503 microversion: 2.1 time: 0.411985 Jul 28 05:32:23.436129 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 79/157] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:23 2022] GET /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103 => generated 1503 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:23.774385 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-ab236cc1-f9d8-4901-a52f-875f06634a0d tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:23.776044 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-ab236cc1-f9d8-4901-a52f-875f06634a0d tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 86f5c96f-2d88-48b0-862e-ce27c19abfb4] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:23.783713 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-ab236cc1-f9d8-4901-a52f-875f06634a0d tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:23.784565 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-ab236cc1-f9d8-4901-a52f-875f06634a0d tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:23.785682 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-ab236cc1-f9d8-4901-a52f-875f06634a0d tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:23.786422 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-ab236cc1-f9d8-4901-a52f-875f06634a0d tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:24.001007 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-7cdf681e-ad43-4ce3-8c81-a8a75dff1497 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:24.001662 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-7cdf681e-ad43-4ce3-8c81-a8a75dff1497 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: f769843b-cb4a-4599-bf54-49d579601a8a] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:24.006163 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:24.011440 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7cdf681e-ad43-4ce3-8c81-a8a75dff1497 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:24.012326 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7cdf681e-ad43-4ce3-8c81-a8a75dff1497 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:24.013757 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7cdf681e-ad43-4ce3-8c81-a8a75dff1497 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:24.014464 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7cdf681e-ad43-4ce3-8c81-a8a75dff1497 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:24.601964 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-ab236cc1-f9d8-4901-a52f-875f06634a0d tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:24.610654 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-ab236cc1-f9d8-4901-a52f-875f06634a0d tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4" status: 200 len: 1322 microversion: 2.1 time: 0.840112 Jul 28 05:32:24.622425 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-7cdf681e-ad43-4ce3-8c81-a8a75dff1497 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:24.624192 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 79/158] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:23 2022] GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4 => generated 1322 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:24.630213 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-7cdf681e-ad43-4ce3-8c81-a8a75dff1497 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a" status: 200 len: 1367 microversion: 2.1 time: 0.633051 Jul 28 05:32:24.630803 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 80/159] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:23 2022] GET /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a => generated 1367 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:25.274589 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [req-f6e80dce-d3f7-441b-acc8-5a590edb77af req-d4edc128-6d2e-431c-ab10-d5f22c581741 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0539d466-3f2e-414a-8563-45ad82a3f268", "tag": "4306092c-5986-4fc4-a865-0baac79b0fbf"}]} {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:32:25.291387 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [req-f6e80dce-d3f7-441b-acc8-5a590edb77af req-d4edc128-6d2e-431c-ab10-d5f22c581741 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:25.291929 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [req-f6e80dce-d3f7-441b-acc8-5a590edb77af req-d4edc128-6d2e-431c-ab10-d5f22c581741 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:25.310400 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-cbdcc95b-8d28-4a98-9cc4-35cbb5c8d08d req-540620e5-4a59-40f6-b50b-a28d86e0e712 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57115a26-af82-499e-a831-4b4c40e60ac5", "tag": "968687ce-4c57-4729-84c6-548124c4123e"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:32:25.311423 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.compute.server_external_events [req-f6e80dce-d3f7-441b-acc8-5a590edb77af req-d4edc128-6d2e-431c-ab10-d5f22c581741 service nova] Creating event network-changed:4306092c-5986-4fc4-a865-0baac79b0fbf for instance 0539d466-3f2e-414a-8563-45ad82a3f268 on hv-cinder-79987 Jul 28 05:32:25.316854 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [req-f6e80dce-d3f7-441b-acc8-5a590edb77af req-d4edc128-6d2e-431c-ab10-d5f22c581741 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046080 Jul 28 05:32:25.320727 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 80/160] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:32:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:32:25.328698 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-cbdcc95b-8d28-4a98-9cc4-35cbb5c8d08d req-540620e5-4a59-40f6-b50b-a28d86e0e712 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:25.329143 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-cbdcc95b-8d28-4a98-9cc4-35cbb5c8d08d req-540620e5-4a59-40f6-b50b-a28d86e0e712 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:25.345216 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-cbdcc95b-8d28-4a98-9cc4-35cbb5c8d08d req-540620e5-4a59-40f6-b50b-a28d86e0e712 service nova] Creating event network-changed:968687ce-4c57-4729-84c6-548124c4123e for instance 57115a26-af82-499e-a831-4b4c40e60ac5 on hv-cinder-79987 Jul 28 05:32:25.352983 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-cbdcc95b-8d28-4a98-9cc4-35cbb5c8d08d req-540620e5-4a59-40f6-b50b-a28d86e0e712 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047781 Jul 28 05:32:25.354286 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 81/161] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:32:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 05:32:25.378152 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-d5a3fd21-4c15-44c8-98cd-703d65c24393 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f5ac75b6-314e-4e8e-9c44-908262177b92"}} {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:32:25.380517 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-d5a3fd21-4c15-44c8-98cd-703d65c24393 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] [instance: 2e6d57a3-f6d1-4b5a-b313-e6cf26eec103] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:25.393215 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-d5a3fd21-4c15-44c8-98cd-703d65c24393 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:25.393690 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-d5a3fd21-4c15-44c8-98cd-703d65c24393 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:25.394544 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-d5a3fd21-4c15-44c8-98cd-703d65c24393 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:25.394974 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-d5a3fd21-4c15-44c8-98cd-703d65c24393 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:25.637948 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-0b4eb1ff-fd7a-419a-b046-3daee4b94474 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:25.639871 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-0b4eb1ff-fd7a-419a-b046-3daee4b94474 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 86f5c96f-2d88-48b0-862e-ce27c19abfb4] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:25.660945 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-0b4eb1ff-fd7a-419a-b046-3daee4b94474 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:25.661396 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-0b4eb1ff-fd7a-419a-b046-3daee4b94474 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:25.671086 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-0b4eb1ff-fd7a-419a-b046-3daee4b94474 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:25.672110 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-0b4eb1ff-fd7a-419a-b046-3daee4b94474 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:25.861174 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-0b4eb1ff-fd7a-419a-b046-3daee4b94474 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:25.869225 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-0b4eb1ff-fd7a-419a-b046-3daee4b94474 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4" status: 200 len: 1322 microversion: 2.1 time: 0.240502 Jul 28 05:32:25.883158 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 82/162] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:25 2022] GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4 => generated 1322 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:25.889185 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-d402b716-ab5a-4c2e-ad9d-8043b511ccea tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:25.890075 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-d402b716-ab5a-4c2e-ad9d-8043b511ccea tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: f769843b-cb4a-4599-bf54-49d579601a8a] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:25.898541 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d402b716-ab5a-4c2e-ad9d-8043b511ccea tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:25.899254 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d402b716-ab5a-4c2e-ad9d-8043b511ccea tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:25.900558 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d402b716-ab5a-4c2e-ad9d-8043b511ccea tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:25.901768 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d402b716-ab5a-4c2e-ad9d-8043b511ccea tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:26.136482 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-d402b716-ab5a-4c2e-ad9d-8043b511ccea tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:26.144768 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-d402b716-ab5a-4c2e-ad9d-8043b511ccea tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a" status: 200 len: 1367 microversion: 2.1 time: 0.260171 Jul 28 05:32:26.145350 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 83/163] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:25 2022] GET /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a => generated 1367 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:26.897807 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-af285574-332d-4db1-bfd7-ca3b721e54bc tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:26.898481 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-af285574-332d-4db1-bfd7-ca3b721e54bc tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 86f5c96f-2d88-48b0-862e-ce27c19abfb4] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:26.911639 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-af285574-332d-4db1-bfd7-ca3b721e54bc tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:26.912086 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-af285574-332d-4db1-bfd7-ca3b721e54bc tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:26.912885 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-af285574-332d-4db1-bfd7-ca3b721e54bc tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:26.916260 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-af285574-332d-4db1-bfd7-ca3b721e54bc tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:27.093273 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-af285574-332d-4db1-bfd7-ca3b721e54bc tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:27.101255 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-af285574-332d-4db1-bfd7-ca3b721e54bc tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4" status: 200 len: 1516 microversion: 2.1 time: 0.212443 Jul 28 05:32:27.101872 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 84/164] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:26 2022] GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4 => generated 1516 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:32:27.122633 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-39736247-8db7-451e-91cd-a711c6069073 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:32:27.125399 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-39736247-8db7-451e-91cd-a711c6069073 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 86f5c96f-2d88-48b0-862e-ce27c19abfb4] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:27.132152 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-39736247-8db7-451e-91cd-a711c6069073 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:27.132713 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-39736247-8db7-451e-91cd-a711c6069073 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:27.133618 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-39736247-8db7-451e-91cd-a711c6069073 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:27.134186 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-39736247-8db7-451e-91cd-a711c6069073 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:27.141047 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-d5a3fd21-4c15-44c8-98cd-703d65c24393 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] 10.222.0.33 "POST /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.767050 Jul 28 05:32:27.141643 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 81/165] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Jul 28 05:32:25 2022] POST /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103/os-volume_attachments => generated 194 bytes in 1769 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:32:27.171810 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-bfee0a30-fe6f-4a99-9de7-7c30e81669ac tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:27.173044 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-bfee0a30-fe6f-4a99-9de7-7c30e81669ac tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: f769843b-cb4a-4599-bf54-49d579601a8a] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:27.190943 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-bfee0a30-fe6f-4a99-9de7-7c30e81669ac tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:27.191397 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-bfee0a30-fe6f-4a99-9de7-7c30e81669ac tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:27.194068 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-bfee0a30-fe6f-4a99-9de7-7c30e81669ac tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:27.194529 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-bfee0a30-fe6f-4a99-9de7-7c30e81669ac tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:27.217243 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.objects.instance [None req-39736247-8db7-451e-91cd-a711c6069073 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lazy-loading 'flavor' on Instance uuid 86f5c96f-2d88-48b0-862e-ce27c19abfb4 {{(pid=124482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 05:32:27.342358 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-bfee0a30-fe6f-4a99-9de7-7c30e81669ac tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:27.349900 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-bfee0a30-fe6f-4a99-9de7-7c30e81669ac tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a" status: 200 len: 1367 microversion: 2.1 time: 0.183374 Jul 28 05:32:27.350467 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 82/166] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:27 2022] GET /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:27.598002 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-39736247-8db7-451e-91cd-a711c6069073 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "POST /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4/action" status: 200 len: 32 microversion: 2.1 time: 0.475975 Jul 28 05:32:27.598002 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 85/167] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Jul 28 05:32:27 2022] POST /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4/action => generated 32 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 05:32:27.607773 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-e487cc87-6d26-4e6c-95e1-2aff40f8361e tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:27.608378 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-e487cc87-6d26-4e6c-95e1-2aff40f8361e tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 86f5c96f-2d88-48b0-862e-ce27c19abfb4] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:27.615553 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-e487cc87-6d26-4e6c-95e1-2aff40f8361e tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:27.616003 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-e487cc87-6d26-4e6c-95e1-2aff40f8361e tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:27.616977 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-e487cc87-6d26-4e6c-95e1-2aff40f8361e tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:27.617438 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-e487cc87-6d26-4e6c-95e1-2aff40f8361e tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:27.640940 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG dbcounter [-] [124483] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:27.818155 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-e487cc87-6d26-4e6c-95e1-2aff40f8361e tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:27.832162 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-e487cc87-6d26-4e6c-95e1-2aff40f8361e tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4" status: 200 len: 1522 microversion: 2.1 time: 0.225714 Jul 28 05:32:27.832868 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 83/168] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:27 2022] GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4 => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:28.372487 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-3d19183b-0c21-4950-a3cf-6a63a03836a5 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:28.373508 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-3d19183b-0c21-4950-a3cf-6a63a03836a5 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: f769843b-cb4a-4599-bf54-49d579601a8a] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:28.379713 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3d19183b-0c21-4950-a3cf-6a63a03836a5 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:28.380352 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3d19183b-0c21-4950-a3cf-6a63a03836a5 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:28.381183 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3d19183b-0c21-4950-a3cf-6a63a03836a5 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:28.381661 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3d19183b-0c21-4950-a3cf-6a63a03836a5 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:28.545920 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-3d19183b-0c21-4950-a3cf-6a63a03836a5 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:28.553449 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-3d19183b-0c21-4950-a3cf-6a63a03836a5 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a" status: 200 len: 1558 microversion: 2.1 time: 0.185791 Jul 28 05:32:28.554067 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 86/169] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:28 2022] GET /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a => generated 1558 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:28.576484 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-105366c2-e77e-4079-a753-6a2d77689669 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:28.577008 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-105366c2-e77e-4079-a753-6a2d77689669 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: f769843b-cb4a-4599-bf54-49d579601a8a] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:28.583898 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-105366c2-e77e-4079-a753-6a2d77689669 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:28.584344 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-105366c2-e77e-4079-a753-6a2d77689669 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:28.585121 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-105366c2-e77e-4079-a753-6a2d77689669 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:28.585736 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-105366c2-e77e-4079-a753-6a2d77689669 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:28.674967 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-105366c2-e77e-4079-a753-6a2d77689669 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.103185 Jul 28 05:32:28.675652 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 84/170] 10.222.0.33 () {58 vars in 1275 bytes} [Thu Jul 28 05:32:28 2022] GET /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:32:28.862623 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-30d7076f-4299-45ca-a0f1-7356f819fd4e tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:28.863392 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-30d7076f-4299-45ca-a0f1-7356f819fd4e tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 86f5c96f-2d88-48b0-862e-ce27c19abfb4] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:28.871140 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-30d7076f-4299-45ca-a0f1-7356f819fd4e tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:28.872297 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-30d7076f-4299-45ca-a0f1-7356f819fd4e tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:28.874565 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-30d7076f-4299-45ca-a0f1-7356f819fd4e tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:28.874565 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-30d7076f-4299-45ca-a0f1-7356f819fd4e tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:29.120690 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-30d7076f-4299-45ca-a0f1-7356f819fd4e tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:29.128415 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-30d7076f-4299-45ca-a0f1-7356f819fd4e tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4" status: 200 len: 1522 microversion: 2.1 time: 0.269911 Jul 28 05:32:29.129208 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 87/171] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:28 2022] GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4 => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:29.986050 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [req-290a0135-aeec-4f45-aaec-87edef599185 req-89698dba-fa95-41e2-8e97-c551ed087579 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f769843b-cb4a-4599-bf54-49d579601a8a", "tag": "b006268e-0b66-4d7e-8674-41ac5075555d"}]} {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:32:29.997110 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [req-290a0135-aeec-4f45-aaec-87edef599185 req-89698dba-fa95-41e2-8e97-c551ed087579 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:29.997596 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [req-290a0135-aeec-4f45-aaec-87edef599185 req-89698dba-fa95-41e2-8e97-c551ed087579 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:30.009848 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.compute.server_external_events [req-290a0135-aeec-4f45-aaec-87edef599185 req-89698dba-fa95-41e2-8e97-c551ed087579 service nova] Creating event network-changed:b006268e-0b66-4d7e-8674-41ac5075555d for instance f769843b-cb4a-4599-bf54-49d579601a8a on hv-cinder-79987 Jul 28 05:32:30.015008 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [req-290a0135-aeec-4f45-aaec-87edef599185 req-89698dba-fa95-41e2-8e97-c551ed087579 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035548 Jul 28 05:32:30.015792 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 85/172] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:32:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:32:30.153635 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-8aa96e9e-8273-49da-9b2f-62e958338d65 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:30.154937 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-8aa96e9e-8273-49da-9b2f-62e958338d65 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 86f5c96f-2d88-48b0-862e-ce27c19abfb4] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:30.162941 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8aa96e9e-8273-49da-9b2f-62e958338d65 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:30.163505 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8aa96e9e-8273-49da-9b2f-62e958338d65 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:30.164500 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8aa96e9e-8273-49da-9b2f-62e958338d65 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:30.165076 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8aa96e9e-8273-49da-9b2f-62e958338d65 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:30.430698 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-8aa96e9e-8273-49da-9b2f-62e958338d65 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:30.440845 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-8aa96e9e-8273-49da-9b2f-62e958338d65 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4" status: 200 len: 1522 microversion: 2.1 time: 0.294854 Jul 28 05:32:30.441517 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 88/173] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:30 2022] GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4 => generated 1522 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:31.464755 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-38b06423-005b-4818-ac13-3181504d2558 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:31.465452 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-38b06423-005b-4818-ac13-3181504d2558 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 86f5c96f-2d88-48b0-862e-ce27c19abfb4] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:31.467428 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG dbcounter [-] [124483] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:31.472360 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-38b06423-005b-4818-ac13-3181504d2558 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:31.472813 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-38b06423-005b-4818-ac13-3181504d2558 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:31.473582 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-38b06423-005b-4818-ac13-3181504d2558 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:31.474009 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-38b06423-005b-4818-ac13-3181504d2558 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:31.656166 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-38b06423-005b-4818-ac13-3181504d2558 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:31.663982 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-38b06423-005b-4818-ac13-3181504d2558 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4" status: 200 len: 1522 microversion: 2.1 time: 0.204836 Jul 28 05:32:31.664556 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 86/174] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:31 2022] GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:32.687357 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-f4281ade-25a9-4cb4-b5d7-5c8b215e0ec4 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:32.688044 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-f4281ade-25a9-4cb4-b5d7-5c8b215e0ec4 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 86f5c96f-2d88-48b0-862e-ce27c19abfb4] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:32.693993 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f4281ade-25a9-4cb4-b5d7-5c8b215e0ec4 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:32.694508 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f4281ade-25a9-4cb4-b5d7-5c8b215e0ec4 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:32.695323 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f4281ade-25a9-4cb4-b5d7-5c8b215e0ec4 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:32.695755 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f4281ade-25a9-4cb4-b5d7-5c8b215e0ec4 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:32.830680 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-f4281ade-25a9-4cb4-b5d7-5c8b215e0ec4 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:32.836428 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-f4281ade-25a9-4cb4-b5d7-5c8b215e0ec4 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4" status: 200 len: 1522 microversion: 2.1 time: 0.153278 Jul 28 05:32:32.837000 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 89/175] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:32 2022] GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:33.857759 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-5cfaea1c-e05c-42e9-8102-3b01bfd9f908 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:33.858372 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-5cfaea1c-e05c-42e9-8102-3b01bfd9f908 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 86f5c96f-2d88-48b0-862e-ce27c19abfb4] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:33.864953 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-5cfaea1c-e05c-42e9-8102-3b01bfd9f908 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:33.865483 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-5cfaea1c-e05c-42e9-8102-3b01bfd9f908 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:33.866258 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-5cfaea1c-e05c-42e9-8102-3b01bfd9f908 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:33.866698 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-5cfaea1c-e05c-42e9-8102-3b01bfd9f908 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:34.002426 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-5cfaea1c-e05c-42e9-8102-3b01bfd9f908 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:34.010127 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-5cfaea1c-e05c-42e9-8102-3b01bfd9f908 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4" status: 200 len: 1522 microversion: 2.1 time: 0.156943 Jul 28 05:32:34.010912 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 87/176] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:33 2022] GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:35.032320 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-55435130-1e59-449b-a75c-19d2c7174a41 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:35.032991 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-55435130-1e59-449b-a75c-19d2c7174a41 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 86f5c96f-2d88-48b0-862e-ce27c19abfb4] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:35.040333 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-55435130-1e59-449b-a75c-19d2c7174a41 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:35.040797 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-55435130-1e59-449b-a75c-19d2c7174a41 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:35.042091 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-55435130-1e59-449b-a75c-19d2c7174a41 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:35.042537 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-55435130-1e59-449b-a75c-19d2c7174a41 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:35.172524 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-55435130-1e59-449b-a75c-19d2c7174a41 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:35.181691 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-55435130-1e59-449b-a75c-19d2c7174a41 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4" status: 200 len: 1522 microversion: 2.1 time: 0.153619 Jul 28 05:32:35.182458 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 90/177] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:35 2022] GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:32:36.208462 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-b298e4bf-1044-477e-afc8-41fa74178b2d tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:36.209836 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-b298e4bf-1044-477e-afc8-41fa74178b2d tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 86f5c96f-2d88-48b0-862e-ce27c19abfb4] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:36.217957 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-b298e4bf-1044-477e-afc8-41fa74178b2d tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:36.218406 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-b298e4bf-1044-477e-afc8-41fa74178b2d tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:36.219420 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-b298e4bf-1044-477e-afc8-41fa74178b2d tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:36.223715 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-b298e4bf-1044-477e-afc8-41fa74178b2d tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:36.360168 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-b298e4bf-1044-477e-afc8-41fa74178b2d tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:36.367811 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-b298e4bf-1044-477e-afc8-41fa74178b2d tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4" status: 200 len: 1522 microversion: 2.1 time: 0.163700 Jul 28 05:32:36.368389 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 88/178] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:36 2022] GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:37.389873 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-fa43bb4a-2fb4-4380-a36e-d47ea19806a3 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:37.391143 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-fa43bb4a-2fb4-4380-a36e-d47ea19806a3 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 86f5c96f-2d88-48b0-862e-ce27c19abfb4] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:37.397871 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-fa43bb4a-2fb4-4380-a36e-d47ea19806a3 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:37.398321 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-fa43bb4a-2fb4-4380-a36e-d47ea19806a3 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:37.399092 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-fa43bb4a-2fb4-4380-a36e-d47ea19806a3 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:37.399528 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-fa43bb4a-2fb4-4380-a36e-d47ea19806a3 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:37.602220 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-fa43bb4a-2fb4-4380-a36e-d47ea19806a3 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:37.611283 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-fa43bb4a-2fb4-4380-a36e-d47ea19806a3 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4" status: 200 len: 1522 microversion: 2.1 time: 0.226936 Jul 28 05:32:37.611855 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 91/179] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:37 2022] GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4 => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:38.633861 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-e078fd09-45ec-4da8-9186-2b986e63b8fc tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:38.635544 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-e078fd09-45ec-4da8-9186-2b986e63b8fc tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 86f5c96f-2d88-48b0-862e-ce27c19abfb4] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:38.640308 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-1ca18ea2-fa3f-4f7f-a056-1e10c3fad197 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:38.641333 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-1ca18ea2-fa3f-4f7f-a056-1e10c3fad197 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] [instance: 2e6d57a3-f6d1-4b5a-b313-e6cf26eec103] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:38.644868 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-e078fd09-45ec-4da8-9186-2b986e63b8fc tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:38.645315 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-e078fd09-45ec-4da8-9186-2b986e63b8fc tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:38.646689 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-e078fd09-45ec-4da8-9186-2b986e63b8fc tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:38.647292 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-e078fd09-45ec-4da8-9186-2b986e63b8fc tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:38.647413 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1ca18ea2-fa3f-4f7f-a056-1e10c3fad197 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:38.647803 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1ca18ea2-fa3f-4f7f-a056-1e10c3fad197 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:38.648602 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1ca18ea2-fa3f-4f7f-a056-1e10c3fad197 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:38.649083 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1ca18ea2-fa3f-4f7f-a056-1e10c3fad197 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:38.676276 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-1ca18ea2-fa3f-4f7f-a056-1e10c3fad197 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] [instance: 2e6d57a3-f6d1-4b5a-b313-e6cf26eec103] Going to try to terminate instance {{(pid=124482) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 05:32:38.805488 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-e078fd09-45ec-4da8-9186-2b986e63b8fc tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:38.815365 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-e078fd09-45ec-4da8-9186-2b986e63b8fc tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4" status: 200 len: 1522 microversion: 2.1 time: 0.186982 Jul 28 05:32:38.817267 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 89/180] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:38 2022] GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:39.016056 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-1ca18ea2-fa3f-4f7f-a056-1e10c3fad197 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103" status: 204 len: 0 microversion: 2.1 time: 0.379285 Jul 28 05:32:39.016971 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 92/181] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Jul 28 05:32:38 2022] DELETE /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 05:32:39.025261 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-a1c1e388-3b81-4ae7-8134-8a3e61a72f15 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:39.026893 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-a1c1e388-3b81-4ae7-8134-8a3e61a72f15 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] [instance: 2e6d57a3-f6d1-4b5a-b313-e6cf26eec103] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:39.032833 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-a1c1e388-3b81-4ae7-8134-8a3e61a72f15 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:39.033285 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-a1c1e388-3b81-4ae7-8134-8a3e61a72f15 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:39.034086 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-a1c1e388-3b81-4ae7-8134-8a3e61a72f15 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:39.034522 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-a1c1e388-3b81-4ae7-8134-8a3e61a72f15 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:39.183288 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-a1c1e388-3b81-4ae7-8134-8a3e61a72f15 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3124696ed4c40029066ceef822f35b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ed205b4a048e18443c6d18b871a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:39.192583 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-a1c1e388-3b81-4ae7-8134-8a3e61a72f15 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] 10.222.0.33 "GET /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103" status: 200 len: 1555 microversion: 2.1 time: 0.171311 Jul 28 05:32:39.193169 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 90/182] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:39 2022] GET /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103 => generated 1555 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:39.836413 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-06116a35-f7a2-4fc5-9fba-b21c15b8a427 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:39.837095 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-06116a35-f7a2-4fc5-9fba-b21c15b8a427 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 86f5c96f-2d88-48b0-862e-ce27c19abfb4] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:39.850021 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-06116a35-f7a2-4fc5-9fba-b21c15b8a427 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:39.850021 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-06116a35-f7a2-4fc5-9fba-b21c15b8a427 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:39.850021 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-06116a35-f7a2-4fc5-9fba-b21c15b8a427 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:39.850021 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-06116a35-f7a2-4fc5-9fba-b21c15b8a427 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:39.867638 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:39.986463 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-06116a35-f7a2-4fc5-9fba-b21c15b8a427 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:39.995631 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-06116a35-f7a2-4fc5-9fba-b21c15b8a427 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4" status: 200 len: 1522 microversion: 2.1 time: 0.163248 Jul 28 05:32:39.996207 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 93/183] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:39 2022] GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:40.214224 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-ae201506-279b-4067-994a-0eacec83cc2a tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:40.214832 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-ae201506-279b-4067-994a-0eacec83cc2a tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] [instance: 2e6d57a3-f6d1-4b5a-b313-e6cf26eec103] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:40.221411 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-ae201506-279b-4067-994a-0eacec83cc2a tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:40.221883 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-ae201506-279b-4067-994a-0eacec83cc2a tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:40.222701 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-ae201506-279b-4067-994a-0eacec83cc2a tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:40.223183 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-ae201506-279b-4067-994a-0eacec83cc2a tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:40.378018 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-ae201506-279b-4067-994a-0eacec83cc2a tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3124696ed4c40029066ceef822f35b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ed205b4a048e18443c6d18b871a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:40.379065 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-ae201506-279b-4067-994a-0eacec83cc2a tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] 10.222.0.33 "GET /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103" status: 200 len: 1555 microversion: 2.1 time: 0.168944 Jul 28 05:32:40.380123 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 91/184] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:40 2022] GET /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103 => generated 1555 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:41.017707 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-a3e3a3f8-52bc-4783-b1c4-4cef1ac3c75a tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:41.018309 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-a3e3a3f8-52bc-4783-b1c4-4cef1ac3c75a tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 86f5c96f-2d88-48b0-862e-ce27c19abfb4] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:41.024297 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a3e3a3f8-52bc-4783-b1c4-4cef1ac3c75a tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:41.025076 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a3e3a3f8-52bc-4783-b1c4-4cef1ac3c75a tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:41.026623 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a3e3a3f8-52bc-4783-b1c4-4cef1ac3c75a tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:41.027075 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a3e3a3f8-52bc-4783-b1c4-4cef1ac3c75a tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:41.158082 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-a3e3a3f8-52bc-4783-b1c4-4cef1ac3c75a tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:41.165679 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-a3e3a3f8-52bc-4783-b1c4-4cef1ac3c75a tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4" status: 200 len: 1522 microversion: 2.1 time: 0.152583 Jul 28 05:32:41.167099 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 94/185] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:41 2022] GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:41.401688 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-f15623d9-db64-40e9-990d-dba749aaaa53 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:41.402302 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-f15623d9-db64-40e9-990d-dba749aaaa53 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] [instance: 2e6d57a3-f6d1-4b5a-b313-e6cf26eec103] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:41.408732 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-f15623d9-db64-40e9-990d-dba749aaaa53 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:41.409210 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-f15623d9-db64-40e9-990d-dba749aaaa53 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:41.410060 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-f15623d9-db64-40e9-990d-dba749aaaa53 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:41.410437 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-f15623d9-db64-40e9-990d-dba749aaaa53 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:41.567019 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-f15623d9-db64-40e9-990d-dba749aaaa53 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3124696ed4c40029066ceef822f35b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ed205b4a048e18443c6d18b871a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:41.575403 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-f15623d9-db64-40e9-990d-dba749aaaa53 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] 10.222.0.33 "GET /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103" status: 200 len: 1555 microversion: 2.1 time: 0.178046 Jul 28 05:32:41.589621 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 92/186] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:41 2022] GET /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103 => generated 1555 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:42.188702 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-db9e7dd4-b407-43c3-9088-d2e61615110e tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:42.190296 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-db9e7dd4-b407-43c3-9088-d2e61615110e tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 86f5c96f-2d88-48b0-862e-ce27c19abfb4] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:42.199341 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-db9e7dd4-b407-43c3-9088-d2e61615110e tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:42.200013 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-db9e7dd4-b407-43c3-9088-d2e61615110e tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:42.201267 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-db9e7dd4-b407-43c3-9088-d2e61615110e tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:42.201752 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-db9e7dd4-b407-43c3-9088-d2e61615110e tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:42.232441 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [req-359ad54e-0af3-48f1-94bb-fb3264693592 req-00cec6ff-732f-4509-96f4-6eb24bb19966 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e6d57a3-f6d1-4b5a-b313-e6cf26eec103", "name": "network-vif-deleted", "tag": "dea42e8c-f00e-4206-92e3-ecad08848a56"}]} {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:32:42.271787 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [req-359ad54e-0af3-48f1-94bb-fb3264693592 req-00cec6ff-732f-4509-96f4-6eb24bb19966 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:42.274815 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [req-359ad54e-0af3-48f1-94bb-fb3264693592 req-00cec6ff-732f-4509-96f4-6eb24bb19966 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:42.289563 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.compute.server_external_events [req-359ad54e-0af3-48f1-94bb-fb3264693592 req-00cec6ff-732f-4509-96f4-6eb24bb19966 service nova] Creating event network-vif-deleted:dea42e8c-f00e-4206-92e3-ecad08848a56 for instance 2e6d57a3-f6d1-4b5a-b313-e6cf26eec103 on hv-cinder-79987 Jul 28 05:32:42.296929 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [req-359ad54e-0af3-48f1-94bb-fb3264693592 req-00cec6ff-732f-4509-96f4-6eb24bb19966 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071874 Jul 28 05:32:42.297917 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 93/187] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:32:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 05:32:42.380196 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-db9e7dd4-b407-43c3-9088-d2e61615110e tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:42.388766 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-db9e7dd4-b407-43c3-9088-d2e61615110e tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4" status: 200 len: 1522 microversion: 2.1 time: 0.205211 Jul 28 05:32:42.389342 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 95/188] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:42 2022] GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:32:42.597867 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-cdad1a97-2eea-4ef8-82f8-ae779138c6fa tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:42.598565 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-cdad1a97-2eea-4ef8-82f8-ae779138c6fa tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] [instance: 2e6d57a3-f6d1-4b5a-b313-e6cf26eec103] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:42.605657 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-cdad1a97-2eea-4ef8-82f8-ae779138c6fa tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:42.606100 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-cdad1a97-2eea-4ef8-82f8-ae779138c6fa tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:42.606860 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-cdad1a97-2eea-4ef8-82f8-ae779138c6fa tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:42.607303 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-cdad1a97-2eea-4ef8-82f8-ae779138c6fa tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:42.670587 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-cdad1a97-2eea-4ef8-82f8-ae779138c6fa tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3124696ed4c40029066ceef822f35b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ed205b4a048e18443c6d18b871a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:42.678541 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-cdad1a97-2eea-4ef8-82f8-ae779138c6fa tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] 10.222.0.33 "GET /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103" status: 200 len: 1346 microversion: 2.1 time: 0.085437 Jul 28 05:32:42.679115 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 94/189] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:42 2022] GET /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103 => generated 1346 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:43.410914 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-f3d58518-a552-46e9-803d-fa48c7aa86a4 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:43.411527 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-f3d58518-a552-46e9-803d-fa48c7aa86a4 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 86f5c96f-2d88-48b0-862e-ce27c19abfb4] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:43.417898 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f3d58518-a552-46e9-803d-fa48c7aa86a4 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:43.418856 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f3d58518-a552-46e9-803d-fa48c7aa86a4 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:43.419088 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f3d58518-a552-46e9-803d-fa48c7aa86a4 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:43.419613 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f3d58518-a552-46e9-803d-fa48c7aa86a4 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:43.547749 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-f3d58518-a552-46e9-803d-fa48c7aa86a4 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:43.555234 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-f3d58518-a552-46e9-803d-fa48c7aa86a4 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4" status: 200 len: 1522 microversion: 2.1 time: 0.148246 Jul 28 05:32:43.555804 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 96/190] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:43 2022] GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:43.700390 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-478919d2-acd4-4500-9fa2-7c075630d376 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:43.700996 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-478919d2-acd4-4500-9fa2-7c075630d376 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] [instance: 2e6d57a3-f6d1-4b5a-b313-e6cf26eec103] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:43.707497 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-478919d2-acd4-4500-9fa2-7c075630d376 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:43.707941 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-478919d2-acd4-4500-9fa2-7c075630d376 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:43.708700 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-478919d2-acd4-4500-9fa2-7c075630d376 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:43.709129 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-478919d2-acd4-4500-9fa2-7c075630d376 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:43.777093 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-478919d2-acd4-4500-9fa2-7c075630d376 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3124696ed4c40029066ceef822f35b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ed205b4a048e18443c6d18b871a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:43.785093 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-478919d2-acd4-4500-9fa2-7c075630d376 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] 10.222.0.33 "GET /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103" status: 200 len: 1346 microversion: 2.1 time: 0.089125 Jul 28 05:32:43.785703 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 95/191] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:43 2022] GET /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103 => generated 1346 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:44.576299 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-da3122cc-64ef-481a-a1e9-48989af5f816 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:44.576918 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-da3122cc-64ef-481a-a1e9-48989af5f816 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 86f5c96f-2d88-48b0-862e-ce27c19abfb4] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:44.582874 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-da3122cc-64ef-481a-a1e9-48989af5f816 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:44.585929 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-da3122cc-64ef-481a-a1e9-48989af5f816 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:44.585929 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-da3122cc-64ef-481a-a1e9-48989af5f816 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:44.585929 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-da3122cc-64ef-481a-a1e9-48989af5f816 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:44.714443 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-da3122cc-64ef-481a-a1e9-48989af5f816 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:44.721998 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-da3122cc-64ef-481a-a1e9-48989af5f816 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4" status: 200 len: 1522 microversion: 2.1 time: 0.149910 Jul 28 05:32:44.722580 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 97/192] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:44 2022] GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:44.806190 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-c68e8d37-edcb-4740-87f4-d2acd434f30b tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:44.807488 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-c68e8d37-edcb-4740-87f4-d2acd434f30b tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] [instance: 2e6d57a3-f6d1-4b5a-b313-e6cf26eec103] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:44.814138 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-c68e8d37-edcb-4740-87f4-d2acd434f30b tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:44.814529 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-c68e8d37-edcb-4740-87f4-d2acd434f30b tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:44.815299 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-c68e8d37-edcb-4740-87f4-d2acd434f30b tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:44.815742 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-c68e8d37-edcb-4740-87f4-d2acd434f30b tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:44.879397 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-c68e8d37-edcb-4740-87f4-d2acd434f30b tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3124696ed4c40029066ceef822f35b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ed205b4a048e18443c6d18b871a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:44.887457 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-c68e8d37-edcb-4740-87f4-d2acd434f30b tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] 10.222.0.33 "GET /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103" status: 200 len: 1346 microversion: 2.1 time: 0.085076 Jul 28 05:32:44.888035 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 96/193] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:44 2022] GET /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103 => generated 1346 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:45.743701 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-032792d8-ea0d-4f9d-b5ed-6a70b4ff528b tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:45.744307 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-032792d8-ea0d-4f9d-b5ed-6a70b4ff528b tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 86f5c96f-2d88-48b0-862e-ce27c19abfb4] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:45.750447 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-032792d8-ea0d-4f9d-b5ed-6a70b4ff528b tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:45.750895 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-032792d8-ea0d-4f9d-b5ed-6a70b4ff528b tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:45.751646 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-032792d8-ea0d-4f9d-b5ed-6a70b4ff528b tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:45.752075 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-032792d8-ea0d-4f9d-b5ed-6a70b4ff528b tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:45.908568 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-df73158c-28ca-44ee-9809-8f56f880f0c3 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:45.909156 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-df73158c-28ca-44ee-9809-8f56f880f0c3 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] [instance: 2e6d57a3-f6d1-4b5a-b313-e6cf26eec103] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:45.916331 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-df73158c-28ca-44ee-9809-8f56f880f0c3 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:45.916788 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-df73158c-28ca-44ee-9809-8f56f880f0c3 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:45.917614 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-df73158c-28ca-44ee-9809-8f56f880f0c3 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:45.918057 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-df73158c-28ca-44ee-9809-8f56f880f0c3 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:46.108321 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-df73158c-28ca-44ee-9809-8f56f880f0c3 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3124696ed4c40029066ceef822f35b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ed205b4a048e18443c6d18b871a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:46.116869 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-df73158c-28ca-44ee-9809-8f56f880f0c3 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] 10.222.0.33 "GET /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103" status: 200 len: 1346 microversion: 2.1 time: 0.212347 Jul 28 05:32:46.131560 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 97/194] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:45 2022] GET /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103 => generated 1346 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:32:46.197933 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-032792d8-ea0d-4f9d-b5ed-6a70b4ff528b tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:46.212399 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-032792d8-ea0d-4f9d-b5ed-6a70b4ff528b tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4" status: 200 len: 1522 microversion: 2.1 time: 0.467506 Jul 28 05:32:46.212399 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 98/195] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:45 2022] GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4 => generated 1522 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:47.139316 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-49098e9b-5bb3-4514-8b4c-b35d2ade43b9 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:47.139937 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-49098e9b-5bb3-4514-8b4c-b35d2ade43b9 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] [instance: 2e6d57a3-f6d1-4b5a-b313-e6cf26eec103] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:47.146545 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-49098e9b-5bb3-4514-8b4c-b35d2ade43b9 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:47.147129 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-49098e9b-5bb3-4514-8b4c-b35d2ade43b9 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:47.147896 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-49098e9b-5bb3-4514-8b4c-b35d2ade43b9 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:47.148334 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-49098e9b-5bb3-4514-8b4c-b35d2ade43b9 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:47.210646 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-49098e9b-5bb3-4514-8b4c-b35d2ade43b9 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3124696ed4c40029066ceef822f35b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ed205b4a048e18443c6d18b871a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:47.219411 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-49098e9b-5bb3-4514-8b4c-b35d2ade43b9 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] 10.222.0.33 "GET /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103" status: 200 len: 1346 microversion: 2.1 time: 0.084866 Jul 28 05:32:47.223540 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 98/196] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:47 2022] GET /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103 => generated 1346 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:47.231304 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-cc640699-adb7-4c3c-b07e-3a8434534e73 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:47.231943 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-cc640699-adb7-4c3c-b07e-3a8434534e73 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 86f5c96f-2d88-48b0-862e-ce27c19abfb4] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:47.237982 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-cc640699-adb7-4c3c-b07e-3a8434534e73 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:47.238424 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-cc640699-adb7-4c3c-b07e-3a8434534e73 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:47.239172 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-cc640699-adb7-4c3c-b07e-3a8434534e73 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:47.239604 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-cc640699-adb7-4c3c-b07e-3a8434534e73 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:47.368294 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-cc640699-adb7-4c3c-b07e-3a8434534e73 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:47.377422 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-cc640699-adb7-4c3c-b07e-3a8434534e73 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4" status: 200 len: 1522 microversion: 2.1 time: 0.149770 Jul 28 05:32:47.377926 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 99/197] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:47 2022] GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:48.239992 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-558a4a9c-8628-4571-8788-e89c4d4e741d tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:48.240523 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-558a4a9c-8628-4571-8788-e89c4d4e741d tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] [instance: 2e6d57a3-f6d1-4b5a-b313-e6cf26eec103] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:48.247169 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-558a4a9c-8628-4571-8788-e89c4d4e741d tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:48.247620 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-558a4a9c-8628-4571-8788-e89c4d4e741d tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:48.248385 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-558a4a9c-8628-4571-8788-e89c4d4e741d tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:48.248822 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-558a4a9c-8628-4571-8788-e89c4d4e741d tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:48.309315 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-558a4a9c-8628-4571-8788-e89c4d4e741d tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3124696ed4c40029066ceef822f35b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ed205b4a048e18443c6d18b871a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:48.317108 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-558a4a9c-8628-4571-8788-e89c4d4e741d tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] 10.222.0.33 "GET /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103" status: 200 len: 1346 microversion: 2.1 time: 0.081082 Jul 28 05:32:48.317717 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 99/198] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:48 2022] GET /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103 => generated 1346 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:48.398909 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-84c7fea5-d63c-4f8f-91e3-5a8786d4c917 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:48.399784 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-84c7fea5-d63c-4f8f-91e3-5a8786d4c917 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 86f5c96f-2d88-48b0-862e-ce27c19abfb4] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:48.406564 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-84c7fea5-d63c-4f8f-91e3-5a8786d4c917 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:48.407521 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-84c7fea5-d63c-4f8f-91e3-5a8786d4c917 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:48.407746 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-84c7fea5-d63c-4f8f-91e3-5a8786d4c917 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:48.408182 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-84c7fea5-d63c-4f8f-91e3-5a8786d4c917 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:48.540679 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-84c7fea5-d63c-4f8f-91e3-5a8786d4c917 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:48.548271 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-84c7fea5-d63c-4f8f-91e3-5a8786d4c917 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4" status: 200 len: 1522 microversion: 2.1 time: 0.153253 Jul 28 05:32:48.548834 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 100/199] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:48 2022] GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:49.338427 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-0b6e541a-1815-4712-b2e9-4cbebbdd9fef tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:49.339086 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-0b6e541a-1815-4712-b2e9-4cbebbdd9fef tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] [instance: 2e6d57a3-f6d1-4b5a-b313-e6cf26eec103] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:49.346151 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-0b6e541a-1815-4712-b2e9-4cbebbdd9fef tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:49.349940 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-0b6e541a-1815-4712-b2e9-4cbebbdd9fef tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:49.349940 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-0b6e541a-1815-4712-b2e9-4cbebbdd9fef tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:49.349940 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-0b6e541a-1815-4712-b2e9-4cbebbdd9fef tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:49.379549 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-0b6e541a-1815-4712-b2e9-4cbebbdd9fef tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:49.379916 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-0b6e541a-1815-4712-b2e9-4cbebbdd9fef tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:49.380375 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.objects.instance [None req-0b6e541a-1815-4712-b2e9-4cbebbdd9fef tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lazy-loading 'fault' on Instance uuid 2e6d57a3-f6d1-4b5a-b313-e6cf26eec103 {{(pid=124483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 05:32:49.423493 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-0b6e541a-1815-4712-b2e9-4cbebbdd9fef tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3124696ed4c40029066ceef822f35b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5ed205b4a048e18443c6d18b871a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:49.431439 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-0b6e541a-1815-4712-b2e9-4cbebbdd9fef tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] 10.222.0.33 "GET /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103" status: 200 len: 1351 microversion: 2.1 time: 0.096872 Jul 28 05:32:49.432041 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 100/200] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:49 2022] GET /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103 => generated 1351 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:32:49.568442 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-2dd3e150-cf19-4e94-bfaa-17d9b978f278 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:49.569061 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-2dd3e150-cf19-4e94-bfaa-17d9b978f278 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 86f5c96f-2d88-48b0-862e-ce27c19abfb4] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:49.576282 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2dd3e150-cf19-4e94-bfaa-17d9b978f278 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:49.576731 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2dd3e150-cf19-4e94-bfaa-17d9b978f278 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:49.577517 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2dd3e150-cf19-4e94-bfaa-17d9b978f278 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:49.577957 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2dd3e150-cf19-4e94-bfaa-17d9b978f278 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:49.604698 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-7f39a159-2bd3-497f-8c3f-78211100d03d tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1435311063", "imageRef": "4f0ce061-6677-4c2a-9ee1-54a100f21462", "flavorRef": "452", "networks": [{"uuid": "6e095ba2-9c3e-4bcc-b330-5cb1fbb72ecf"}]}} {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:32:49.661659 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.network.neutron [None req-7f39a159-2bd3-497f-8c3f-78211100d03d tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] validate_networks() for [('6e095ba2-9c3e-4bcc-b330-5cb1fbb72ecf', None, None, None, None, None)] {{(pid=124483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 05:32:49.788668 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-2dd3e150-cf19-4e94-bfaa-17d9b978f278 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:49.797600 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-2dd3e150-cf19-4e94-bfaa-17d9b978f278 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4" status: 200 len: 1522 microversion: 2.1 time: 0.233153 Jul 28 05:32:49.798292 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 101/201] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:49 2022] GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4 => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:50.073039 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.virt.hardware [None req-7f39a159-2bd3-497f-8c3f-78211100d03d tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Flavor limits 0:0:0 {{(pid=124483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 05:32:50.073485 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.virt.hardware [None req-7f39a159-2bd3-497f-8c3f-78211100d03d tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Image limits 0:0:0 {{(pid=124483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 05:32:50.073972 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.virt.hardware [None req-7f39a159-2bd3-497f-8c3f-78211100d03d tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Flavor pref 0:0:0 {{(pid=124483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 05:32:50.074387 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.virt.hardware [None req-7f39a159-2bd3-497f-8c3f-78211100d03d tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Image pref 0:0:0 {{(pid=124483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 05:32:50.075334 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.virt.hardware [None req-7f39a159-2bd3-497f-8c3f-78211100d03d tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 05:32:50.086594 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-7f39a159-2bd3-497f-8c3f-78211100d03d tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:50.086594 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-7f39a159-2bd3-497f-8c3f-78211100d03d tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:50.086594 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-7f39a159-2bd3-497f-8c3f-78211100d03d tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:50.086594 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-7f39a159-2bd3-497f-8c3f-78211100d03d tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:50.104495 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.quota [None req-7f39a159-2bd3-497f-8c3f-78211100d03d tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Getting quotas for project 0fafe3a7726844018a6c308f8acdbb49. Resources: {'ram', 'instances', 'cores'} {{(pid=124483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 05:32:50.108832 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.quota [None req-7f39a159-2bd3-497f-8c3f-78211100d03d tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Getting quotas for user 02142b6537394571912b52f061aeb082 and project 0fafe3a7726844018a6c308f8acdbb49. Resources: {'ram', 'instances', 'cores'} {{(pid=124483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 05:32:50.120403 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-7f39a159-2bd3-497f-8c3f-78211100d03d tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Going to run 1 instances... {{(pid=124483) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 05:32:50.123020 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-7f39a159-2bd3-497f-8c3f-78211100d03d tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] [instance: 38be4c9a-b055-46f2-a269-f67214cd08ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f0ce061-6677-4c2a-9ee1-54a100f21462',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 05:32:50.326868 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-7f39a159-2bd3-497f-8c3f-78211100d03d tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.725949 Jul 28 05:32:50.327579 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 101/202] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Jul 28 05:32:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 05:32:50.338303 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-9b414481-57cf-4840-b74c-6235c2ee7832 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:50.339235 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-9b414481-57cf-4840-b74c-6235c2ee7832 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] [instance: 38be4c9a-b055-46f2-a269-f67214cd08ff] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:50.404550 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-9b414481-57cf-4840-b74c-6235c2ee7832 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02142b6537394571912b52f061aeb082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fafe3a7726844018a6c308f8acdbb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:50.411481 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-9b414481-57cf-4840-b74c-6235c2ee7832 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] 10.222.0.33 "GET /compute/v2.1/servers/38be4c9a-b055-46f2-a269-f67214cd08ff" status: 200 len: 1219 microversion: 2.1 time: 0.076912 Jul 28 05:32:50.412224 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 102/203] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:50 2022] GET /compute/v2.1/servers/38be4c9a-b055-46f2-a269-f67214cd08ff => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:50.457185 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-099186d7-e2ee-41b4-9b00-2298ae4f2278 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:50.457185 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-099186d7-e2ee-41b4-9b00-2298ae4f2278 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] [instance: 2e6d57a3-f6d1-4b5a-b313-e6cf26eec103] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:50.463696 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-099186d7-e2ee-41b4-9b00-2298ae4f2278 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:50.464249 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-099186d7-e2ee-41b4-9b00-2298ae4f2278 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:50.467134 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-099186d7-e2ee-41b4-9b00-2298ae4f2278 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:50.467875 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-099186d7-e2ee-41b4-9b00-2298ae4f2278 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:50.474040 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG dbcounter [-] [124483] Writing DB stats nova_cell1:SELECT=100 {{(pid=124483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:50.488293 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.wsgi [None req-099186d7-e2ee-41b4-9b00-2298ae4f2278 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] HTTP exception thrown: Instance 2e6d57a3-f6d1-4b5a-b313-e6cf26eec103 could not be found. Jul 28 05:32:50.493024 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-099186d7-e2ee-41b4-9b00-2298ae4f2278 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Request method failure captured: Jul 28 05:32:50.493024 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: request: GET /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103 HTTP/1.1 Jul 28 05:32:50.493024 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Accept: application/json Jul 28 05:32:50.493024 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Accept-Encoding: identity Jul 28 05:32:50.493024 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Connection: close Jul 28 05:32:50.493024 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Content-Length: 0 Jul 28 05:32:50.493024 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Content-Type: application/json Jul 28 05:32:50.493024 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Host: 10.222.0.33 Jul 28 05:32:50.493024 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Openstack-System-Scope: None Jul 28 05:32:50.493024 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: User-Agent: python-urllib3/1.26.10 Jul 28 05:32:50.493024 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Auth-Token: gAAAAABi4h89f_3KV0OkNdMXb9wH4x76pCmv5OhkOPagK35EKVMzrQzitKPyNMEVyob3mwsUlmIZzQDEs7q6YFiM_rUd5M18ak1Hyo_FFfrBuzUhq3MhbxeHFRQ6NiGu4SAvtwzUF9dZoxgm6BcAq5GJNb7A9JZYy82wmaEiEWntQ2ohtzNTwUk Jul 28 05:32:50.493024 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Domain-Id: None Jul 28 05:32:50.493024 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Domain-Name: None Jul 28 05:32:50.493024 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Identity-Status: Confirmed Jul 28 05:32:50.493024 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Is-Admin-Project: True Jul 28 05:32:50.493024 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Project-Domain-Id: default Jul 28 05:32:50.493024 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Project-Domain-Name: Default Jul 28 05:32:50.493024 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Project-Id: ee5ed205b4a048e18443c6d18b871a90 Jul 28 05:32:50.493024 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Project-Name: tempest-DeleteServersTestJSON-270237440 Jul 28 05:32:50.493024 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Role: member,reader Jul 28 05:32:50.493024 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Roles: member,reader Jul 28 05:32:50.494278 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ee5ed205b4a048e18443c6d18b871a90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ee5ed205b4a048e18443c6d18b871a90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ee5ed205b4a048e18443c6d18b871a90", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ee5ed205b4a048e18443c6d18b871a90"}]}] Jul 28 05:32:50.494278 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Tenant: tempest-DeleteServersTestJSON-270237440 Jul 28 05:32:50.494278 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Tenant-Id: ee5ed205b4a048e18443c6d18b871a90 Jul 28 05:32:50.494278 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Tenant-Name: tempest-DeleteServersTestJSON-270237440 Jul 28 05:32:50.494278 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-User: tempest-DeleteServersTestJSON-270237440-project Jul 28 05:32:50.494278 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-User-Domain-Id: default Jul 28 05:32:50.494278 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-User-Domain-Name: Default Jul 28 05:32:50.494278 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-User-Id: b3124696ed4c40029066ceef822f35b7 Jul 28 05:32:50.494278 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-User-Name: tempest-DeleteServersTestJSON-270237440-project Jul 28 05:32:50.494278 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: method: > Jul 28 05:32:50.494278 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: exception: Instance 2e6d57a3-f6d1-4b5a-b313-e6cf26eec103 could not be found. Jul 28 05:32:50.494278 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: action_args: {'id': '2e6d57a3-f6d1-4b5a-b313-e6cf26eec103'} Jul 28 05:32:50.495104 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 05:32:50.495104 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:32:50.495104 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 05:32:50.495104 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 05:32:50.495104 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 05:32:50.495104 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 05:32:50.495104 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 05:32:50.495104 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 05:32:50.495104 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 05:32:50.495104 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 05:32:50.495104 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e6d57a3-f6d1-4b5a-b313-e6cf26eec103 could not be found. Jul 28 05:32:50.495104 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Jul 28 05:32:50.495104 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:32:50.495104 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Jul 28 05:32:50.495104 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:32:50.495104 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:32:50.495104 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:32:50.495104 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 05:32:50.495104 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 05:32:50.495104 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 05:32:50.496224 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:32:50.496224 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 05:32:50.496224 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 05:32:50.496224 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 05:32:50.496224 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 05:32:50.496224 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 05:32:50.496224 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 05:32:50.496224 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e6d57a3-f6d1-4b5a-b313-e6cf26eec103 could not be found. Jul 28 05:32:50.496224 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Jul 28 05:32:50.496224 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:32:50.496224 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Jul 28 05:32:50.496224 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:32:50.496224 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:32:50.496224 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:32:50.496224 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 05:32:50.496224 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 05:32:50.496224 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e6d57a3-f6d1-4b5a-b313-e6cf26eec103 could not be found. Jul 28 05:32:50.496224 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Jul 28 05:32:50.497251 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-099186d7-e2ee-41b4-9b00-2298ae4f2278 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Returning 404 to user: Instance 2e6d57a3-f6d1-4b5a-b313-e6cf26eec103 could not be found. {{(pid=124483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 05:32:50.497251 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-099186d7-e2ee-41b4-9b00-2298ae4f2278 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] 10.222.0.33 "GET /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103" status: 404 len: 111 microversion: 2.1 time: 0.042510 Jul 28 05:32:50.497251 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 102/204] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:50 2022] GET /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 05:32:50.613848 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-b8d3bf6a-9120-4970-b100-ab1c8f9c2c4c tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:50.616047 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-b8d3bf6a-9120-4970-b100-ab1c8f9c2c4c tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] [instance: 2e6d57a3-f6d1-4b5a-b313-e6cf26eec103] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:50.622232 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b8d3bf6a-9120-4970-b100-ab1c8f9c2c4c tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:50.622680 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b8d3bf6a-9120-4970-b100-ab1c8f9c2c4c tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:50.623580 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b8d3bf6a-9120-4970-b100-ab1c8f9c2c4c tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:50.623994 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b8d3bf6a-9120-4970-b100-ab1c8f9c2c4c tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:50.638080 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.wsgi [None req-b8d3bf6a-9120-4970-b100-ab1c8f9c2c4c tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] HTTP exception thrown: Instance 2e6d57a3-f6d1-4b5a-b313-e6cf26eec103 could not be found. Jul 28 05:32:50.642239 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-b8d3bf6a-9120-4970-b100-ab1c8f9c2c4c tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Request method failure captured: Jul 28 05:32:50.642239 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: request: GET /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103/os-volume_attachments HTTP/1.1 Jul 28 05:32:50.642239 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept: application/json Jul 28 05:32:50.642239 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept-Encoding: identity Jul 28 05:32:50.642239 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Connection: close Jul 28 05:32:50.642239 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Length: 0 Jul 28 05:32:50.642239 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Type: application/json Jul 28 05:32:50.642239 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Host: 10.222.0.33 Jul 28 05:32:50.642239 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Openstack-System-Scope: None Jul 28 05:32:50.642239 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: User-Agent: python-urllib3/1.26.10 Jul 28 05:32:50.642239 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Auth-Token: gAAAAABi4h89f_3KV0OkNdMXb9wH4x76pCmv5OhkOPagK35EKVMzrQzitKPyNMEVyob3mwsUlmIZzQDEs7q6YFiM_rUd5M18ak1Hyo_FFfrBuzUhq3MhbxeHFRQ6NiGu4SAvtwzUF9dZoxgm6BcAq5GJNb7A9JZYy82wmaEiEWntQ2ohtzNTwUk Jul 28 05:32:50.642239 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Id: None Jul 28 05:32:50.642239 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Name: None Jul 28 05:32:50.642239 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Identity-Status: Confirmed Jul 28 05:32:50.642239 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Is-Admin-Project: True Jul 28 05:32:50.642239 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Id: default Jul 28 05:32:50.642239 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Name: Default Jul 28 05:32:50.642239 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Id: ee5ed205b4a048e18443c6d18b871a90 Jul 28 05:32:50.642239 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Name: tempest-DeleteServersTestJSON-270237440 Jul 28 05:32:50.642239 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Role: member,reader Jul 28 05:32:50.642239 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Roles: member,reader Jul 28 05:32:50.643651 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ee5ed205b4a048e18443c6d18b871a90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ee5ed205b4a048e18443c6d18b871a90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ee5ed205b4a048e18443c6d18b871a90", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ee5ed205b4a048e18443c6d18b871a90"}]}] Jul 28 05:32:50.643651 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant: tempest-DeleteServersTestJSON-270237440 Jul 28 05:32:50.643651 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Id: ee5ed205b4a048e18443c6d18b871a90 Jul 28 05:32:50.643651 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Name: tempest-DeleteServersTestJSON-270237440 Jul 28 05:32:50.643651 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User: tempest-DeleteServersTestJSON-270237440-project Jul 28 05:32:50.643651 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Id: default Jul 28 05:32:50.643651 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Name: Default Jul 28 05:32:50.643651 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Id: b3124696ed4c40029066ceef822f35b7 Jul 28 05:32:50.643651 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Name: tempest-DeleteServersTestJSON-270237440-project Jul 28 05:32:50.643651 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: method: > Jul 28 05:32:50.643651 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: exception: Instance 2e6d57a3-f6d1-4b5a-b313-e6cf26eec103 could not be found. Jul 28 05:32:50.643651 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: action_args: {'server_id': '2e6d57a3-f6d1-4b5a-b313-e6cf26eec103'} Jul 28 05:32:50.644421 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 05:32:50.644421 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:32:50.644421 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 05:32:50.644421 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 05:32:50.644421 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 05:32:50.644421 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 05:32:50.644421 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 05:32:50.644421 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 05:32:50.644421 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 05:32:50.644421 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 05:32:50.644421 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e6d57a3-f6d1-4b5a-b313-e6cf26eec103 could not be found. Jul 28 05:32:50.644421 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:32:50.644421 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:32:50.644421 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:32:50.644421 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:32:50.644421 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:32:50.644421 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:32:50.644421 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 05:32:50.644421 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 05:32:50.644421 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 05:32:50.645489 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:32:50.645489 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 05:32:50.645489 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 05:32:50.645489 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 05:32:50.645489 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 05:32:50.645489 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 28 05:32:50.645489 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 28 05:32:50.645489 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 05:32:50.645489 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 05:32:50.645489 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e6d57a3-f6d1-4b5a-b313-e6cf26eec103 could not be found. Jul 28 05:32:50.645489 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:32:50.645489 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:32:50.645489 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:32:50.645489 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:32:50.645489 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:32:50.645489 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:32:50.645489 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 05:32:50.645489 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 05:32:50.645489 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e6d57a3-f6d1-4b5a-b313-e6cf26eec103 could not be found. Jul 28 05:32:50.645489 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:32:50.646656 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-b8d3bf6a-9120-4970-b100-ab1c8f9c2c4c tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Returning 404 to user: Instance 2e6d57a3-f6d1-4b5a-b313-e6cf26eec103 could not be found. {{(pid=124482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 05:32:50.646656 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-b8d3bf6a-9120-4970-b100-ab1c8f9c2c4c tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] 10.222.0.33 "GET /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033988 Jul 28 05:32:50.646656 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 103/205] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Jul 28 05:32:50 2022] GET /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 05:32:50.819334 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-74aac753-bcd2-4580-84e2-6c3021e23199 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:50.819955 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-74aac753-bcd2-4580-84e2-6c3021e23199 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 86f5c96f-2d88-48b0-862e-ce27c19abfb4] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:50.827211 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-74aac753-bcd2-4580-84e2-6c3021e23199 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:50.827667 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-74aac753-bcd2-4580-84e2-6c3021e23199 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:50.828445 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-74aac753-bcd2-4580-84e2-6c3021e23199 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:50.828887 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-74aac753-bcd2-4580-84e2-6c3021e23199 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:50.977345 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-74aac753-bcd2-4580-84e2-6c3021e23199 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:50.986121 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-74aac753-bcd2-4580-84e2-6c3021e23199 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4" status: 200 len: 1522 microversion: 2.1 time: 0.170970 Jul 28 05:32:50.986682 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 103/206] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:50 2022] GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:51.432678 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-20f211fb-e05a-4684-ad2a-2cb935290ec4 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:51.433283 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-20f211fb-e05a-4684-ad2a-2cb935290ec4 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] [instance: 38be4c9a-b055-46f2-a269-f67214cd08ff] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:51.488412 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-20f211fb-e05a-4684-ad2a-2cb935290ec4 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02142b6537394571912b52f061aeb082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fafe3a7726844018a6c308f8acdbb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:51.495038 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-20f211fb-e05a-4684-ad2a-2cb935290ec4 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] 10.222.0.33 "GET /compute/v2.1/servers/38be4c9a-b055-46f2-a269-f67214cd08ff" status: 200 len: 1219 microversion: 2.1 time: 0.066447 Jul 28 05:32:51.498466 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 104/207] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:51 2022] GET /compute/v2.1/servers/38be4c9a-b055-46f2-a269-f67214cd08ff => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:52.008029 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-b6f44606-26f6-4229-af50-e76ecf9c099e tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:52.009340 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-b6f44606-26f6-4229-af50-e76ecf9c099e tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 86f5c96f-2d88-48b0-862e-ce27c19abfb4] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:52.021938 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-b6f44606-26f6-4229-af50-e76ecf9c099e tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:52.021938 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-b6f44606-26f6-4229-af50-e76ecf9c099e tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:52.021938 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-b6f44606-26f6-4229-af50-e76ecf9c099e tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:52.021938 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-b6f44606-26f6-4229-af50-e76ecf9c099e tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:52.080973 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-e31c2a4b-bb5a-4e75-9507-02823cdb5691 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:52.082384 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-e31c2a4b-bb5a-4e75-9507-02823cdb5691 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] [instance: 2e6d57a3-f6d1-4b5a-b313-e6cf26eec103] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:52.091629 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e31c2a4b-bb5a-4e75-9507-02823cdb5691 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:52.092132 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e31c2a4b-bb5a-4e75-9507-02823cdb5691 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:52.093061 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e31c2a4b-bb5a-4e75-9507-02823cdb5691 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:52.093618 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e31c2a4b-bb5a-4e75-9507-02823cdb5691 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:52.109058 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.wsgi [None req-e31c2a4b-bb5a-4e75-9507-02823cdb5691 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] HTTP exception thrown: Instance 2e6d57a3-f6d1-4b5a-b313-e6cf26eec103 could not be found. Jul 28 05:32:52.111884 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-e31c2a4b-bb5a-4e75-9507-02823cdb5691 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Request method failure captured: Jul 28 05:32:52.111884 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: request: DELETE /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103 HTTP/1.1 Jul 28 05:32:52.111884 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept: application/json Jul 28 05:32:52.111884 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept-Encoding: identity Jul 28 05:32:52.111884 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Connection: close Jul 28 05:32:52.111884 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Length: 0 Jul 28 05:32:52.111884 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Type: application/json Jul 28 05:32:52.111884 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Host: 10.222.0.33 Jul 28 05:32:52.111884 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Openstack-System-Scope: None Jul 28 05:32:52.111884 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: User-Agent: python-urllib3/1.26.10 Jul 28 05:32:52.111884 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Auth-Token: gAAAAABi4h89f_3KV0OkNdMXb9wH4x76pCmv5OhkOPagK35EKVMzrQzitKPyNMEVyob3mwsUlmIZzQDEs7q6YFiM_rUd5M18ak1Hyo_FFfrBuzUhq3MhbxeHFRQ6NiGu4SAvtwzUF9dZoxgm6BcAq5GJNb7A9JZYy82wmaEiEWntQ2ohtzNTwUk Jul 28 05:32:52.111884 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Id: None Jul 28 05:32:52.111884 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Name: None Jul 28 05:32:52.111884 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Identity-Status: Confirmed Jul 28 05:32:52.111884 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Is-Admin-Project: True Jul 28 05:32:52.111884 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Id: default Jul 28 05:32:52.111884 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Name: Default Jul 28 05:32:52.111884 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Id: ee5ed205b4a048e18443c6d18b871a90 Jul 28 05:32:52.111884 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Name: tempest-DeleteServersTestJSON-270237440 Jul 28 05:32:52.111884 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Role: member,reader Jul 28 05:32:52.111884 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Roles: member,reader Jul 28 05:32:52.113388 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ee5ed205b4a048e18443c6d18b871a90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ee5ed205b4a048e18443c6d18b871a90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ee5ed205b4a048e18443c6d18b871a90", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ee5ed205b4a048e18443c6d18b871a90"}]}] Jul 28 05:32:52.113388 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant: tempest-DeleteServersTestJSON-270237440 Jul 28 05:32:52.113388 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Id: ee5ed205b4a048e18443c6d18b871a90 Jul 28 05:32:52.113388 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Name: tempest-DeleteServersTestJSON-270237440 Jul 28 05:32:52.113388 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User: tempest-DeleteServersTestJSON-270237440-project Jul 28 05:32:52.113388 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Id: default Jul 28 05:32:52.113388 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Name: Default Jul 28 05:32:52.113388 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Id: b3124696ed4c40029066ceef822f35b7 Jul 28 05:32:52.113388 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Name: tempest-DeleteServersTestJSON-270237440-project Jul 28 05:32:52.113388 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: method: > Jul 28 05:32:52.113388 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: exception: Instance 2e6d57a3-f6d1-4b5a-b313-e6cf26eec103 could not be found. Jul 28 05:32:52.113388 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: action_args: {'id': '2e6d57a3-f6d1-4b5a-b313-e6cf26eec103'} Jul 28 05:32:52.114432 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 05:32:52.114432 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:32:52.114432 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 05:32:52.114432 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 05:32:52.114432 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 05:32:52.114432 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 05:32:52.114432 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 05:32:52.114432 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 05:32:52.114432 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 05:32:52.114432 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 05:32:52.114432 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e6d57a3-f6d1-4b5a-b313-e6cf26eec103 could not be found. Jul 28 05:32:52.114432 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:32:52.114432 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:32:52.114432 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:32:52.114432 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:32:52.114432 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:32:52.114432 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:32:52.114432 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 05:32:52.114432 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 05:32:52.114432 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 05:32:52.115856 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:32:52.115856 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 05:32:52.115856 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 05:32:52.115856 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 05:32:52.115856 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 05:32:52.115856 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 05:32:52.115856 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 05:32:52.115856 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 05:32:52.115856 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 05:32:52.115856 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e6d57a3-f6d1-4b5a-b313-e6cf26eec103 could not be found. Jul 28 05:32:52.115856 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:32:52.115856 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:32:52.115856 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:32:52.115856 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:32:52.115856 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:32:52.115856 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:32:52.115856 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 05:32:52.115856 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 05:32:52.115856 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e6d57a3-f6d1-4b5a-b313-e6cf26eec103 could not be found. Jul 28 05:32:52.115856 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:32:52.117218 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-e31c2a4b-bb5a-4e75-9507-02823cdb5691 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Returning 404 to user: Instance 2e6d57a3-f6d1-4b5a-b313-e6cf26eec103 could not be found. {{(pid=124482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 05:32:52.117218 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-e31c2a4b-bb5a-4e75-9507-02823cdb5691 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103" status: 404 len: 111 microversion: 2.1 time: 0.036235 Jul 28 05:32:52.117218 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 105/208] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Jul 28 05:32:52 2022] DELETE /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 05:32:52.122346 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-332343d6-be68-4e05-a581-d9df1c7adc62 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:52.122957 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-332343d6-be68-4e05-a581-d9df1c7adc62 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] [instance: 2e6d57a3-f6d1-4b5a-b313-e6cf26eec103] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:52.129389 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-332343d6-be68-4e05-a581-d9df1c7adc62 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:52.129873 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-332343d6-be68-4e05-a581-d9df1c7adc62 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:52.130640 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-332343d6-be68-4e05-a581-d9df1c7adc62 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:52.131083 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-332343d6-be68-4e05-a581-d9df1c7adc62 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:52.146418 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.wsgi [None req-332343d6-be68-4e05-a581-d9df1c7adc62 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] HTTP exception thrown: Instance 2e6d57a3-f6d1-4b5a-b313-e6cf26eec103 could not be found. Jul 28 05:32:52.147942 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-332343d6-be68-4e05-a581-d9df1c7adc62 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Request method failure captured: Jul 28 05:32:52.147942 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: request: GET /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103 HTTP/1.1 Jul 28 05:32:52.147942 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept: application/json Jul 28 05:32:52.147942 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept-Encoding: identity Jul 28 05:32:52.147942 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Connection: close Jul 28 05:32:52.147942 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Length: 0 Jul 28 05:32:52.147942 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Type: application/json Jul 28 05:32:52.147942 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Host: 10.222.0.33 Jul 28 05:32:52.147942 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Openstack-System-Scope: None Jul 28 05:32:52.147942 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: User-Agent: python-urllib3/1.26.10 Jul 28 05:32:52.147942 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Auth-Token: gAAAAABi4h89f_3KV0OkNdMXb9wH4x76pCmv5OhkOPagK35EKVMzrQzitKPyNMEVyob3mwsUlmIZzQDEs7q6YFiM_rUd5M18ak1Hyo_FFfrBuzUhq3MhbxeHFRQ6NiGu4SAvtwzUF9dZoxgm6BcAq5GJNb7A9JZYy82wmaEiEWntQ2ohtzNTwUk Jul 28 05:32:52.147942 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Id: None Jul 28 05:32:52.147942 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Name: None Jul 28 05:32:52.147942 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Identity-Status: Confirmed Jul 28 05:32:52.147942 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Is-Admin-Project: True Jul 28 05:32:52.147942 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Id: default Jul 28 05:32:52.147942 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Name: Default Jul 28 05:32:52.147942 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Id: ee5ed205b4a048e18443c6d18b871a90 Jul 28 05:32:52.147942 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Name: tempest-DeleteServersTestJSON-270237440 Jul 28 05:32:52.147942 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Role: member,reader Jul 28 05:32:52.147942 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Roles: member,reader Jul 28 05:32:52.150362 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ee5ed205b4a048e18443c6d18b871a90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ee5ed205b4a048e18443c6d18b871a90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ee5ed205b4a048e18443c6d18b871a90", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ee5ed205b4a048e18443c6d18b871a90"}]}] Jul 28 05:32:52.150362 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant: tempest-DeleteServersTestJSON-270237440 Jul 28 05:32:52.150362 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Id: ee5ed205b4a048e18443c6d18b871a90 Jul 28 05:32:52.150362 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Name: tempest-DeleteServersTestJSON-270237440 Jul 28 05:32:52.150362 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User: tempest-DeleteServersTestJSON-270237440-project Jul 28 05:32:52.150362 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Id: default Jul 28 05:32:52.150362 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Name: Default Jul 28 05:32:52.150362 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Id: b3124696ed4c40029066ceef822f35b7 Jul 28 05:32:52.150362 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Name: tempest-DeleteServersTestJSON-270237440-project Jul 28 05:32:52.150362 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: method: > Jul 28 05:32:52.150362 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: exception: Instance 2e6d57a3-f6d1-4b5a-b313-e6cf26eec103 could not be found. Jul 28 05:32:52.150362 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: action_args: {'id': '2e6d57a3-f6d1-4b5a-b313-e6cf26eec103'} Jul 28 05:32:52.151209 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 05:32:52.151209 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:32:52.151209 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 05:32:52.151209 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 05:32:52.151209 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 05:32:52.151209 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 05:32:52.151209 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 05:32:52.151209 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 05:32:52.151209 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 05:32:52.151209 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 05:32:52.151209 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e6d57a3-f6d1-4b5a-b313-e6cf26eec103 could not be found. Jul 28 05:32:52.151209 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:32:52.151209 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:32:52.151209 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:32:52.151209 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:32:52.151209 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:32:52.151209 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:32:52.151209 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 05:32:52.151209 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 05:32:52.151209 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 05:32:52.152223 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:32:52.152223 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 05:32:52.152223 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 05:32:52.152223 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 05:32:52.152223 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 05:32:52.152223 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 05:32:52.152223 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 05:32:52.152223 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e6d57a3-f6d1-4b5a-b313-e6cf26eec103 could not be found. Jul 28 05:32:52.152223 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:32:52.152223 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:32:52.152223 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:32:52.152223 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:32:52.152223 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:32:52.152223 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:32:52.152223 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 05:32:52.152223 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 05:32:52.152223 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e6d57a3-f6d1-4b5a-b313-e6cf26eec103 could not be found. Jul 28 05:32:52.152223 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:32:52.153995 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-332343d6-be68-4e05-a581-d9df1c7adc62 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] Returning 404 to user: Instance 2e6d57a3-f6d1-4b5a-b313-e6cf26eec103 could not be found. {{(pid=124482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 05:32:52.153995 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-332343d6-be68-4e05-a581-d9df1c7adc62 tempest-DeleteServersTestJSON-270237440 tempest-DeleteServersTestJSON-270237440-project] 10.222.0.33 "GET /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103" status: 404 len: 111 microversion: 2.1 time: 0.031776 Jul 28 05:32:52.153995 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 106/209] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:52 2022] GET /compute/v2.1/servers/2e6d57a3-f6d1-4b5a-b313-e6cf26eec103 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 05:32:52.205416 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-b6f44606-26f6-4229-af50-e76ecf9c099e tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:52.213215 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-b6f44606-26f6-4229-af50-e76ecf9c099e tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4" status: 200 len: 1522 microversion: 2.1 time: 0.209332 Jul 28 05:32:52.213828 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 104/210] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:52 2022] GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:52.516997 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-d1b7a4cc-94c8-4792-855e-ca93f2061c53 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:52.518046 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-d1b7a4cc-94c8-4792-855e-ca93f2061c53 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] [instance: 38be4c9a-b055-46f2-a269-f67214cd08ff] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:52.524846 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d1b7a4cc-94c8-4792-855e-ca93f2061c53 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:52.525383 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d1b7a4cc-94c8-4792-855e-ca93f2061c53 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:52.526426 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d1b7a4cc-94c8-4792-855e-ca93f2061c53 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:52.526927 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d1b7a4cc-94c8-4792-855e-ca93f2061c53 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:52.608690 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-d1b7a4cc-94c8-4792-855e-ca93f2061c53 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02142b6537394571912b52f061aeb082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fafe3a7726844018a6c308f8acdbb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:52.621285 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-d1b7a4cc-94c8-4792-855e-ca93f2061c53 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] 10.222.0.33 "GET /compute/v2.1/servers/38be4c9a-b055-46f2-a269-f67214cd08ff" status: 200 len: 1271 microversion: 2.1 time: 0.108543 Jul 28 05:32:52.623090 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 107/211] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:52 2022] GET /compute/v2.1/servers/38be4c9a-b055-46f2-a269-f67214cd08ff => generated 1271 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:53.237909 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-533dc2c3-f2fe-4e43-8504-95b4252fa11d tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:53.238623 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-533dc2c3-f2fe-4e43-8504-95b4252fa11d tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 86f5c96f-2d88-48b0-862e-ce27c19abfb4] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:53.245686 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-533dc2c3-f2fe-4e43-8504-95b4252fa11d tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:53.246139 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-533dc2c3-f2fe-4e43-8504-95b4252fa11d tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:53.248174 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-533dc2c3-f2fe-4e43-8504-95b4252fa11d tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:53.249292 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-533dc2c3-f2fe-4e43-8504-95b4252fa11d tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:53.504085 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-533dc2c3-f2fe-4e43-8504-95b4252fa11d tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:53.515249 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-533dc2c3-f2fe-4e43-8504-95b4252fa11d tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4" status: 200 len: 1522 microversion: 2.1 time: 0.284139 Jul 28 05:32:53.516396 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 105/212] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:53 2022] GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4 => generated 1522 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:53.644316 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-3e723df0-5e5e-48ab-b279-c5ca46d5edf1 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:53.644929 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-3e723df0-5e5e-48ab-b279-c5ca46d5edf1 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] [instance: 38be4c9a-b055-46f2-a269-f67214cd08ff] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:53.651368 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3e723df0-5e5e-48ab-b279-c5ca46d5edf1 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:53.651763 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3e723df0-5e5e-48ab-b279-c5ca46d5edf1 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:53.652531 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3e723df0-5e5e-48ab-b279-c5ca46d5edf1 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:53.653540 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3e723df0-5e5e-48ab-b279-c5ca46d5edf1 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:53.895407 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-3e723df0-5e5e-48ab-b279-c5ca46d5edf1 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02142b6537394571912b52f061aeb082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fafe3a7726844018a6c308f8acdbb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:53.917261 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-3e723df0-5e5e-48ab-b279-c5ca46d5edf1 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] 10.222.0.33 "GET /compute/v2.1/servers/38be4c9a-b055-46f2-a269-f67214cd08ff" status: 200 len: 1319 microversion: 2.1 time: 0.271791 Jul 28 05:32:53.917261 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 108/213] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:53 2022] GET /compute/v2.1/servers/38be4c9a-b055-46f2-a269-f67214cd08ff => generated 1319 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:54.538515 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-5bb76f1c-e9d8-4db6-af35-21825dc249f2 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:54.539412 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-5bb76f1c-e9d8-4db6-af35-21825dc249f2 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 86f5c96f-2d88-48b0-862e-ce27c19abfb4] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:54.548837 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-5bb76f1c-e9d8-4db6-af35-21825dc249f2 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:54.549415 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-5bb76f1c-e9d8-4db6-af35-21825dc249f2 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:54.550610 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-5bb76f1c-e9d8-4db6-af35-21825dc249f2 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:54.552931 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-5bb76f1c-e9d8-4db6-af35-21825dc249f2 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:54.792062 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-5bb76f1c-e9d8-4db6-af35-21825dc249f2 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:54.811842 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-5bb76f1c-e9d8-4db6-af35-21825dc249f2 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4" status: 200 len: 1522 microversion: 2.1 time: 0.278162 Jul 28 05:32:54.826586 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 106/214] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:54 2022] GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4 => generated 1522 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:54.936381 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-90143e65-b49e-41db-9715-702b1c9b15e9 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:54.936979 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-90143e65-b49e-41db-9715-702b1c9b15e9 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] [instance: 38be4c9a-b055-46f2-a269-f67214cd08ff] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:54.939931 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:54.943980 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-90143e65-b49e-41db-9715-702b1c9b15e9 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:54.944417 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-90143e65-b49e-41db-9715-702b1c9b15e9 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:54.945166 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-90143e65-b49e-41db-9715-702b1c9b15e9 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:54.945629 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-90143e65-b49e-41db-9715-702b1c9b15e9 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:55.017331 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [req-9c1212bc-0467-434c-9036-61a918ffcb14 req-2c08d94c-73d0-4f72-b411-df8e68bc30ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38be4c9a-b055-46f2-a269-f67214cd08ff", "tag": "f2e46983-fbb4-4369-a1ec-16bd6bc4d642"}]} {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:32:55.028238 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [req-9c1212bc-0467-434c-9036-61a918ffcb14 req-2c08d94c-73d0-4f72-b411-df8e68bc30ba service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:55.028764 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [req-9c1212bc-0467-434c-9036-61a918ffcb14 req-2c08d94c-73d0-4f72-b411-df8e68bc30ba service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:55.040309 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.compute.server_external_events [req-9c1212bc-0467-434c-9036-61a918ffcb14 req-2c08d94c-73d0-4f72-b411-df8e68bc30ba service nova] Creating event network-changed:f2e46983-fbb4-4369-a1ec-16bd6bc4d642 for instance 38be4c9a-b055-46f2-a269-f67214cd08ff on hv-cinder-79987 Jul 28 05:32:55.049264 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [req-9c1212bc-0467-434c-9036-61a918ffcb14 req-2c08d94c-73d0-4f72-b411-df8e68bc30ba service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033695 Jul 28 05:32:55.049264 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 107/215] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:32:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:32:55.131874 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-90143e65-b49e-41db-9715-702b1c9b15e9 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02142b6537394571912b52f061aeb082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fafe3a7726844018a6c308f8acdbb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:55.141625 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-90143e65-b49e-41db-9715-702b1c9b15e9 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] 10.222.0.33 "GET /compute/v2.1/servers/38be4c9a-b055-46f2-a269-f67214cd08ff" status: 200 len: 1319 microversion: 2.1 time: 0.209260 Jul 28 05:32:55.142211 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 109/216] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:54 2022] GET /compute/v2.1/servers/38be4c9a-b055-46f2-a269-f67214cd08ff => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:55.837805 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-625ca12e-0ca3-4cbb-a608-8345752f9ee7 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:55.838577 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-625ca12e-0ca3-4cbb-a608-8345752f9ee7 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 86f5c96f-2d88-48b0-862e-ce27c19abfb4] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:55.846992 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-625ca12e-0ca3-4cbb-a608-8345752f9ee7 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:55.847541 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-625ca12e-0ca3-4cbb-a608-8345752f9ee7 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:55.848387 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-625ca12e-0ca3-4cbb-a608-8345752f9ee7 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:55.848902 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-625ca12e-0ca3-4cbb-a608-8345752f9ee7 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:56.036814 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-625ca12e-0ca3-4cbb-a608-8345752f9ee7 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:56.046435 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-625ca12e-0ca3-4cbb-a608-8345752f9ee7 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4" status: 200 len: 1522 microversion: 2.1 time: 0.213635 Jul 28 05:32:56.061030 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 108/217] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:55 2022] GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4 => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:32:56.163070 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-ef8a21f3-3885-4efc-8a33-230b17d4e24e tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:56.163692 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-ef8a21f3-3885-4efc-8a33-230b17d4e24e tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] [instance: 38be4c9a-b055-46f2-a269-f67214cd08ff] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:56.170599 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ef8a21f3-3885-4efc-8a33-230b17d4e24e tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:56.171050 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ef8a21f3-3885-4efc-8a33-230b17d4e24e tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:56.171812 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ef8a21f3-3885-4efc-8a33-230b17d4e24e tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:56.172247 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ef8a21f3-3885-4efc-8a33-230b17d4e24e tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:56.329394 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-ef8a21f3-3885-4efc-8a33-230b17d4e24e tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02142b6537394571912b52f061aeb082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fafe3a7726844018a6c308f8acdbb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:56.337485 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-ef8a21f3-3885-4efc-8a33-230b17d4e24e tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] 10.222.0.33 "GET /compute/v2.1/servers/38be4c9a-b055-46f2-a269-f67214cd08ff" status: 200 len: 1319 microversion: 2.1 time: 0.178242 Jul 28 05:32:56.338879 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 110/218] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:56 2022] GET /compute/v2.1/servers/38be4c9a-b055-46f2-a269-f67214cd08ff => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:57.067647 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-ca05f3d7-1483-409f-ac2d-bcae6629acca tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:57.068957 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-ca05f3d7-1483-409f-ac2d-bcae6629acca tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 86f5c96f-2d88-48b0-862e-ce27c19abfb4] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:57.075991 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-ca05f3d7-1483-409f-ac2d-bcae6629acca tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:57.076495 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-ca05f3d7-1483-409f-ac2d-bcae6629acca tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:57.077271 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-ca05f3d7-1483-409f-ac2d-bcae6629acca tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:57.077745 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-ca05f3d7-1483-409f-ac2d-bcae6629acca tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:57.216970 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-ca05f3d7-1483-409f-ac2d-bcae6629acca tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:57.224772 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-ca05f3d7-1483-409f-ac2d-bcae6629acca tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4" status: 200 len: 1522 microversion: 2.1 time: 0.160977 Jul 28 05:32:57.225348 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 109/219] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:57 2022] GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:57.360140 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-c6847493-2261-4ee3-b06e-71be05be1cdc tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:57.360763 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-c6847493-2261-4ee3-b06e-71be05be1cdc tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] [instance: 38be4c9a-b055-46f2-a269-f67214cd08ff] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:57.367175 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c6847493-2261-4ee3-b06e-71be05be1cdc tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:57.367613 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c6847493-2261-4ee3-b06e-71be05be1cdc tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:57.368386 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c6847493-2261-4ee3-b06e-71be05be1cdc tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:57.368811 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c6847493-2261-4ee3-b06e-71be05be1cdc tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:57.508521 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-c6847493-2261-4ee3-b06e-71be05be1cdc tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02142b6537394571912b52f061aeb082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fafe3a7726844018a6c308f8acdbb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:57.516789 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-c6847493-2261-4ee3-b06e-71be05be1cdc tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] 10.222.0.33 "GET /compute/v2.1/servers/38be4c9a-b055-46f2-a269-f67214cd08ff" status: 200 len: 1319 microversion: 2.1 time: 0.161310 Jul 28 05:32:57.517373 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 111/220] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:57 2022] GET /compute/v2.1/servers/38be4c9a-b055-46f2-a269-f67214cd08ff => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:58.246038 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-6c8e6829-4567-48bf-9408-3e8f4b301ffc tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:58.247362 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-6c8e6829-4567-48bf-9408-3e8f4b301ffc tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 86f5c96f-2d88-48b0-862e-ce27c19abfb4] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:58.253832 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-6c8e6829-4567-48bf-9408-3e8f4b301ffc tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:58.254275 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-6c8e6829-4567-48bf-9408-3e8f4b301ffc tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:58.255141 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-6c8e6829-4567-48bf-9408-3e8f4b301ffc tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:58.255567 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-6c8e6829-4567-48bf-9408-3e8f4b301ffc tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:58.396895 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-6c8e6829-4567-48bf-9408-3e8f4b301ffc tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:58.406252 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-6c8e6829-4567-48bf-9408-3e8f4b301ffc tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4" status: 200 len: 1502 microversion: 2.1 time: 0.163940 Jul 28 05:32:58.406837 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 110/221] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:58 2022] GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4 => generated 1502 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:58.426783 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-ac4fa029-238b-43b2-acf3-929d1a9b93f1 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:58.427393 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-ac4fa029-238b-43b2-acf3-929d1a9b93f1 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: d70d71f4-de27-4d62-acad-c6e9a7a7225e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:58.433405 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ac4fa029-238b-43b2-acf3-929d1a9b93f1 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:58.434566 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ac4fa029-238b-43b2-acf3-929d1a9b93f1 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:58.435347 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ac4fa029-238b-43b2-acf3-929d1a9b93f1 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:58.435781 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ac4fa029-238b-43b2-acf3-929d1a9b93f1 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:58.539103 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-dd3b7794-d1d8-4ab0-b733-d9ee154e76a1 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:58.539733 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-dd3b7794-d1d8-4ab0-b733-d9ee154e76a1 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] [instance: 38be4c9a-b055-46f2-a269-f67214cd08ff] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:58.546798 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-dd3b7794-d1d8-4ab0-b733-d9ee154e76a1 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:58.547175 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-dd3b7794-d1d8-4ab0-b733-d9ee154e76a1 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:58.547950 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-dd3b7794-d1d8-4ab0-b733-d9ee154e76a1 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:58.548393 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-dd3b7794-d1d8-4ab0-b733-d9ee154e76a1 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:58.568800 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-ac4fa029-238b-43b2-acf3-929d1a9b93f1 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:58.576979 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-ac4fa029-238b-43b2-acf3-929d1a9b93f1 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/d70d71f4-de27-4d62-acad-c6e9a7a7225e" status: 200 len: 1516 microversion: 2.1 time: 0.153978 Jul 28 05:32:58.578247 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 112/222] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:58 2022] GET /compute/v2.1/servers/d70d71f4-de27-4d62-acad-c6e9a7a7225e => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:32:58.707489 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-dd3b7794-d1d8-4ab0-b733-d9ee154e76a1 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02142b6537394571912b52f061aeb082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fafe3a7726844018a6c308f8acdbb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:58.717560 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-dd3b7794-d1d8-4ab0-b733-d9ee154e76a1 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] 10.222.0.33 "GET /compute/v2.1/servers/38be4c9a-b055-46f2-a269-f67214cd08ff" status: 200 len: 1319 microversion: 2.1 time: 0.182446 Jul 28 05:32:58.718151 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 111/223] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:58 2022] GET /compute/v2.1/servers/38be4c9a-b055-46f2-a269-f67214cd08ff => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:32:59.742531 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-9bc189fe-8e18-411c-93c2-36d68378ab5f tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:32:59.743619 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-9bc189fe-8e18-411c-93c2-36d68378ab5f tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] [instance: 38be4c9a-b055-46f2-a269-f67214cd08ff] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:32:59.751271 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9bc189fe-8e18-411c-93c2-36d68378ab5f tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:59.756317 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9bc189fe-8e18-411c-93c2-36d68378ab5f tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:59.756317 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9bc189fe-8e18-411c-93c2-36d68378ab5f tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:32:59.756317 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9bc189fe-8e18-411c-93c2-36d68378ab5f tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:32:59.920416 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-9bc189fe-8e18-411c-93c2-36d68378ab5f tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02142b6537394571912b52f061aeb082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fafe3a7726844018a6c308f8acdbb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:32:59.922648 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell1:SELECT=100 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:59.928502 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-9bc189fe-8e18-411c-93c2-36d68378ab5f tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] 10.222.0.33 "GET /compute/v2.1/servers/38be4c9a-b055-46f2-a269-f67214cd08ff" status: 200 len: 1319 microversion: 2.1 time: 0.192433 Jul 28 05:32:59.929080 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 113/224] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:32:59 2022] GET /compute/v2.1/servers/38be4c9a-b055-46f2-a269-f67214cd08ff => generated 1319 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:33:00.354390 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-482f1b48-b149-44e6-9068-823a9723612f tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:33:00.356837 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-482f1b48-b149-44e6-9068-823a9723612f tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: d70d71f4-de27-4d62-acad-c6e9a7a7225e] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:00.359310 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG dbcounter [-] [124483] Writing DB stats nova_cell0:SELECT=2 {{(pid=124483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:33:00.359967 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG dbcounter [-] [124483] Writing DB stats nova_cell0:SELECT=6 {{(pid=124483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:33:00.364735 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-482f1b48-b149-44e6-9068-823a9723612f tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:00.365185 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-482f1b48-b149-44e6-9068-823a9723612f tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:00.365988 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-482f1b48-b149-44e6-9068-823a9723612f tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:00.366430 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-482f1b48-b149-44e6-9068-823a9723612f tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:00.390278 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.objects.instance [None req-482f1b48-b149-44e6-9068-823a9723612f tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lazy-loading 'flavor' on Instance uuid d70d71f4-de27-4d62-acad-c6e9a7a7225e {{(pid=124483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 05:33:00.752025 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-482f1b48-b149-44e6-9068-823a9723612f tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "POST /compute/v2.1/servers/d70d71f4-de27-4d62-acad-c6e9a7a7225e/action" status: 200 len: 32 microversion: 2.1 time: 0.401435 Jul 28 05:33:00.752545 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 112/225] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Jul 28 05:33:00 2022] POST /compute/v2.1/servers/d70d71f4-de27-4d62-acad-c6e9a7a7225e/action => generated 32 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 05:33:00.763170 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-6176de86-cf49-49c1-a8a7-6f65f14ef893 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:00.763780 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-6176de86-cf49-49c1-a8a7-6f65f14ef893 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: d70d71f4-de27-4d62-acad-c6e9a7a7225e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:00.770303 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-6176de86-cf49-49c1-a8a7-6f65f14ef893 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:00.770748 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-6176de86-cf49-49c1-a8a7-6f65f14ef893 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:00.771513 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-6176de86-cf49-49c1-a8a7-6f65f14ef893 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:00.771964 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-6176de86-cf49-49c1-a8a7-6f65f14ef893 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:00.936030 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-6176de86-cf49-49c1-a8a7-6f65f14ef893 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:00.944378 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-6176de86-cf49-49c1-a8a7-6f65f14ef893 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/d70d71f4-de27-4d62-acad-c6e9a7a7225e" status: 200 len: 1522 microversion: 2.1 time: 0.184548 Jul 28 05:33:00.944378 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 114/226] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:33:00 2022] GET /compute/v2.1/servers/d70d71f4-de27-4d62-acad-c6e9a7a7225e => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:33:00.962854 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-86e1208b-d748-43c5-8a80-78d1c928b671 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:00.963622 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-86e1208b-d748-43c5-8a80-78d1c928b671 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] [instance: 38be4c9a-b055-46f2-a269-f67214cd08ff] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:00.971412 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-86e1208b-d748-43c5-8a80-78d1c928b671 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:00.972010 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-86e1208b-d748-43c5-8a80-78d1c928b671 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:00.972596 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-86e1208b-d748-43c5-8a80-78d1c928b671 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:00.973024 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-86e1208b-d748-43c5-8a80-78d1c928b671 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:01.195285 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-86e1208b-d748-43c5-8a80-78d1c928b671 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02142b6537394571912b52f061aeb082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fafe3a7726844018a6c308f8acdbb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:01.207160 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-86e1208b-d748-43c5-8a80-78d1c928b671 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] 10.222.0.33 "GET /compute/v2.1/servers/38be4c9a-b055-46f2-a269-f67214cd08ff" status: 200 len: 1319 microversion: 2.1 time: 0.248316 Jul 28 05:33:01.208398 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 113/227] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:33:00 2022] GET /compute/v2.1/servers/38be4c9a-b055-46f2-a269-f67214cd08ff => generated 1319 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:33:01.760657 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-59e47008-de7e-463a-a020-6c4fc1a6744d req-67a2a130-f850-4b17-b39d-a65415807071 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38be4c9a-b055-46f2-a269-f67214cd08ff", "name": "network-vif-plugged", "status": "completed", "tag": "f2e46983-fbb4-4369-a1ec-16bd6bc4d642"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:33:01.766031 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell0:SELECT=4 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:33:01.771254 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-59e47008-de7e-463a-a020-6c4fc1a6744d req-67a2a130-f850-4b17-b39d-a65415807071 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:01.771699 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-59e47008-de7e-463a-a020-6c4fc1a6744d req-67a2a130-f850-4b17-b39d-a65415807071 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:01.782982 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-59e47008-de7e-463a-a020-6c4fc1a6744d req-67a2a130-f850-4b17-b39d-a65415807071 service nova] Creating event network-vif-plugged:f2e46983-fbb4-4369-a1ec-16bd6bc4d642 for instance 38be4c9a-b055-46f2-a269-f67214cd08ff on hv-cinder-79987 Jul 28 05:33:01.787848 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-59e47008-de7e-463a-a020-6c4fc1a6744d req-67a2a130-f850-4b17-b39d-a65415807071 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030826 Jul 28 05:33:01.788442 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 115/228] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:33:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:33:01.964272 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-c65ca517-55a8-46e3-94ba-fdeea24ace80 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:01.964918 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-c65ca517-55a8-46e3-94ba-fdeea24ace80 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: d70d71f4-de27-4d62-acad-c6e9a7a7225e] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:01.967477 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG dbcounter [-] [124483] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=124483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:33:01.972239 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-c65ca517-55a8-46e3-94ba-fdeea24ace80 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:01.972706 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-c65ca517-55a8-46e3-94ba-fdeea24ace80 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:01.973537 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-c65ca517-55a8-46e3-94ba-fdeea24ace80 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:01.973973 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-c65ca517-55a8-46e3-94ba-fdeea24ace80 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:02.152248 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-c65ca517-55a8-46e3-94ba-fdeea24ace80 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:02.159896 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-c65ca517-55a8-46e3-94ba-fdeea24ace80 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/d70d71f4-de27-4d62-acad-c6e9a7a7225e" status: 200 len: 1522 microversion: 2.1 time: 0.199580 Jul 28 05:33:02.160490 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 114/229] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:33:01 2022] GET /compute/v2.1/servers/d70d71f4-de27-4d62-acad-c6e9a7a7225e => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:33:02.230709 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-1c73148a-f050-43c7-a028-a0f949d62e82 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:02.231536 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-1c73148a-f050-43c7-a028-a0f949d62e82 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] [instance: 38be4c9a-b055-46f2-a269-f67214cd08ff] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:02.238709 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1c73148a-f050-43c7-a028-a0f949d62e82 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:02.239164 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1c73148a-f050-43c7-a028-a0f949d62e82 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:02.239941 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1c73148a-f050-43c7-a028-a0f949d62e82 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:02.240376 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1c73148a-f050-43c7-a028-a0f949d62e82 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:02.491454 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-1c73148a-f050-43c7-a028-a0f949d62e82 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02142b6537394571912b52f061aeb082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fafe3a7726844018a6c308f8acdbb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:02.499470 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-1c73148a-f050-43c7-a028-a0f949d62e82 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] 10.222.0.33 "GET /compute/v2.1/servers/38be4c9a-b055-46f2-a269-f67214cd08ff" status: 200 len: 1319 microversion: 2.1 time: 0.273744 Jul 28 05:33:02.500054 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 116/230] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:33:02 2022] GET /compute/v2.1/servers/38be4c9a-b055-46f2-a269-f67214cd08ff => generated 1319 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:33:03.182445 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-6d9367c9-998b-426a-bc58-91f2926af83d tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:03.183050 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-6d9367c9-998b-426a-bc58-91f2926af83d tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: d70d71f4-de27-4d62-acad-c6e9a7a7225e] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:03.189669 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-6d9367c9-998b-426a-bc58-91f2926af83d tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:03.190160 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-6d9367c9-998b-426a-bc58-91f2926af83d tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:03.190911 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-6d9367c9-998b-426a-bc58-91f2926af83d tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:03.191346 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-6d9367c9-998b-426a-bc58-91f2926af83d tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:03.332158 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-6d9367c9-998b-426a-bc58-91f2926af83d tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:03.335292 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-6d9367c9-998b-426a-bc58-91f2926af83d tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/d70d71f4-de27-4d62-acad-c6e9a7a7225e" status: 200 len: 1522 microversion: 2.1 time: 0.156739 Jul 28 05:33:03.335867 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 115/231] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:33:03 2022] GET /compute/v2.1/servers/d70d71f4-de27-4d62-acad-c6e9a7a7225e => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:33:03.520790 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-63c13e09-d56d-4977-88d9-4b93f60d2404 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:03.521401 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-63c13e09-d56d-4977-88d9-4b93f60d2404 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] [instance: 38be4c9a-b055-46f2-a269-f67214cd08ff] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:03.528317 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-63c13e09-d56d-4977-88d9-4b93f60d2404 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:03.528759 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-63c13e09-d56d-4977-88d9-4b93f60d2404 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:03.529543 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-63c13e09-d56d-4977-88d9-4b93f60d2404 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:03.529978 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-63c13e09-d56d-4977-88d9-4b93f60d2404 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:03.660334 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-63c13e09-d56d-4977-88d9-4b93f60d2404 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02142b6537394571912b52f061aeb082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fafe3a7726844018a6c308f8acdbb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:03.668133 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-63c13e09-d56d-4977-88d9-4b93f60d2404 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] 10.222.0.33 "GET /compute/v2.1/servers/38be4c9a-b055-46f2-a269-f67214cd08ff" status: 200 len: 1319 microversion: 2.1 time: 0.150725 Jul 28 05:33:03.668701 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 117/232] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:33:03 2022] GET /compute/v2.1/servers/38be4c9a-b055-46f2-a269-f67214cd08ff => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:33:04.356587 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-9f2078a8-121c-4833-a68e-05efba3d3601 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:04.357195 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-9f2078a8-121c-4833-a68e-05efba3d3601 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: d70d71f4-de27-4d62-acad-c6e9a7a7225e] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:04.363726 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-9f2078a8-121c-4833-a68e-05efba3d3601 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:04.364167 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-9f2078a8-121c-4833-a68e-05efba3d3601 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:04.364919 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-9f2078a8-121c-4833-a68e-05efba3d3601 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:04.365344 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-9f2078a8-121c-4833-a68e-05efba3d3601 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:04.492393 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-9f2078a8-121c-4833-a68e-05efba3d3601 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:04.500458 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-9f2078a8-121c-4833-a68e-05efba3d3601 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/d70d71f4-de27-4d62-acad-c6e9a7a7225e" status: 200 len: 1522 microversion: 2.1 time: 0.147981 Jul 28 05:33:04.501025 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 116/233] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:33:04 2022] GET /compute/v2.1/servers/d70d71f4-de27-4d62-acad-c6e9a7a7225e => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:33:04.689362 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-994f74d5-baf3-4278-a009-4d51429d09bb tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:04.689895 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-994f74d5-baf3-4278-a009-4d51429d09bb tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] [instance: 38be4c9a-b055-46f2-a269-f67214cd08ff] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:04.695822 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-994f74d5-baf3-4278-a009-4d51429d09bb tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:04.696261 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-994f74d5-baf3-4278-a009-4d51429d09bb tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:04.697020 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-994f74d5-baf3-4278-a009-4d51429d09bb tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:04.697430 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-994f74d5-baf3-4278-a009-4d51429d09bb tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:04.963617 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-994f74d5-baf3-4278-a009-4d51429d09bb tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02142b6537394571912b52f061aeb082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fafe3a7726844018a6c308f8acdbb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:04.971153 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-994f74d5-baf3-4278-a009-4d51429d09bb tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] 10.222.0.33 "GET /compute/v2.1/servers/38be4c9a-b055-46f2-a269-f67214cd08ff" status: 200 len: 1319 microversion: 2.1 time: 0.285705 Jul 28 05:33:04.971724 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 118/234] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:33:04 2022] GET /compute/v2.1/servers/38be4c9a-b055-46f2-a269-f67214cd08ff => generated 1319 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:33:05.521899 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-f973cac2-494d-4d8d-a536-9a4b745db330 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:05.522432 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-f973cac2-494d-4d8d-a536-9a4b745db330 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: d70d71f4-de27-4d62-acad-c6e9a7a7225e] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:05.529260 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-f973cac2-494d-4d8d-a536-9a4b745db330 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:05.529750 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-f973cac2-494d-4d8d-a536-9a4b745db330 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:05.530513 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-f973cac2-494d-4d8d-a536-9a4b745db330 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:05.530949 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-f973cac2-494d-4d8d-a536-9a4b745db330 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:05.659396 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-f973cac2-494d-4d8d-a536-9a4b745db330 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:05.667150 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-f973cac2-494d-4d8d-a536-9a4b745db330 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/d70d71f4-de27-4d62-acad-c6e9a7a7225e" status: 200 len: 1522 microversion: 2.1 time: 0.149210 Jul 28 05:33:05.668328 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 117/235] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:33:05 2022] GET /compute/v2.1/servers/d70d71f4-de27-4d62-acad-c6e9a7a7225e => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:33:05.991910 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-14d4cef1-a5ca-4ca5-ac54-0e8ece8fed6f tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:05.992519 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-14d4cef1-a5ca-4ca5-ac54-0e8ece8fed6f tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] [instance: 38be4c9a-b055-46f2-a269-f67214cd08ff] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:05.999426 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-14d4cef1-a5ca-4ca5-ac54-0e8ece8fed6f tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:05.999878 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-14d4cef1-a5ca-4ca5-ac54-0e8ece8fed6f tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:06.000631 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-14d4cef1-a5ca-4ca5-ac54-0e8ece8fed6f tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:06.001065 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-14d4cef1-a5ca-4ca5-ac54-0e8ece8fed6f tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:06.131130 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-14d4cef1-a5ca-4ca5-ac54-0e8ece8fed6f tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02142b6537394571912b52f061aeb082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fafe3a7726844018a6c308f8acdbb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:06.138518 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-14d4cef1-a5ca-4ca5-ac54-0e8ece8fed6f tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] 10.222.0.33 "GET /compute/v2.1/servers/38be4c9a-b055-46f2-a269-f67214cd08ff" status: 200 len: 1319 microversion: 2.1 time: 0.150547 Jul 28 05:33:06.139078 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 119/236] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:33:05 2022] GET /compute/v2.1/servers/38be4c9a-b055-46f2-a269-f67214cd08ff => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:33:06.688805 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-48e48f9d-a38f-4ad1-b4c4-70accd7c7a56 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:06.689321 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-48e48f9d-a38f-4ad1-b4c4-70accd7c7a56 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: d70d71f4-de27-4d62-acad-c6e9a7a7225e] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:06.695696 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-48e48f9d-a38f-4ad1-b4c4-70accd7c7a56 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:06.696138 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-48e48f9d-a38f-4ad1-b4c4-70accd7c7a56 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:06.696884 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-48e48f9d-a38f-4ad1-b4c4-70accd7c7a56 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:06.697314 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-48e48f9d-a38f-4ad1-b4c4-70accd7c7a56 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:06.701912 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG dbcounter [-] [124483] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:33:06.826190 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-48e48f9d-a38f-4ad1-b4c4-70accd7c7a56 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:06.833555 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-48e48f9d-a38f-4ad1-b4c4-70accd7c7a56 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/d70d71f4-de27-4d62-acad-c6e9a7a7225e" status: 200 len: 1522 microversion: 2.1 time: 0.148654 Jul 28 05:33:06.834139 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 118/237] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:33:06 2022] GET /compute/v2.1/servers/d70d71f4-de27-4d62-acad-c6e9a7a7225e => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:33:07.159112 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-2786ee63-090c-4021-975f-86599f3e8ccf tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:07.159727 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-2786ee63-090c-4021-975f-86599f3e8ccf tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] [instance: 38be4c9a-b055-46f2-a269-f67214cd08ff] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:07.166048 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2786ee63-090c-4021-975f-86599f3e8ccf tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:07.166498 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2786ee63-090c-4021-975f-86599f3e8ccf tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:07.167302 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2786ee63-090c-4021-975f-86599f3e8ccf tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:07.168260 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2786ee63-090c-4021-975f-86599f3e8ccf tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:07.297350 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-2786ee63-090c-4021-975f-86599f3e8ccf tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02142b6537394571912b52f061aeb082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fafe3a7726844018a6c308f8acdbb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:07.304739 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-2786ee63-090c-4021-975f-86599f3e8ccf tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] 10.222.0.33 "GET /compute/v2.1/servers/38be4c9a-b055-46f2-a269-f67214cd08ff" status: 200 len: 1507 microversion: 2.1 time: 0.149585 Jul 28 05:33:07.305297 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 120/238] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:33:07 2022] GET /compute/v2.1/servers/38be4c9a-b055-46f2-a269-f67214cd08ff => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:33:07.854741 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-19f0f4c8-8661-4c3b-94b3-1516fc1df99a tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:07.856256 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-19f0f4c8-8661-4c3b-94b3-1516fc1df99a tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: d70d71f4-de27-4d62-acad-c6e9a7a7225e] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:07.864491 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-19f0f4c8-8661-4c3b-94b3-1516fc1df99a tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:07.864491 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-19f0f4c8-8661-4c3b-94b3-1516fc1df99a tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:07.864491 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-19f0f4c8-8661-4c3b-94b3-1516fc1df99a tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:07.864740 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-19f0f4c8-8661-4c3b-94b3-1516fc1df99a tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:08.010200 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-19f0f4c8-8661-4c3b-94b3-1516fc1df99a tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:08.018443 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-19f0f4c8-8661-4c3b-94b3-1516fc1df99a tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/d70d71f4-de27-4d62-acad-c6e9a7a7225e" status: 200 len: 1522 microversion: 2.1 time: 0.167922 Jul 28 05:33:08.019091 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 119/239] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:33:07 2022] GET /compute/v2.1/servers/d70d71f4-de27-4d62-acad-c6e9a7a7225e => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:33:09.040083 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-0dbaedf1-cfb5-4dbc-9f3b-33d9e0839ead tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:09.040686 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-0dbaedf1-cfb5-4dbc-9f3b-33d9e0839ead tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: d70d71f4-de27-4d62-acad-c6e9a7a7225e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:09.047582 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-0dbaedf1-cfb5-4dbc-9f3b-33d9e0839ead tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:09.048028 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-0dbaedf1-cfb5-4dbc-9f3b-33d9e0839ead tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:09.048806 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-0dbaedf1-cfb5-4dbc-9f3b-33d9e0839ead tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:09.049237 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-0dbaedf1-cfb5-4dbc-9f3b-33d9e0839ead tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:09.179994 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-0dbaedf1-cfb5-4dbc-9f3b-33d9e0839ead tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:09.187664 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-0dbaedf1-cfb5-4dbc-9f3b-33d9e0839ead tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/d70d71f4-de27-4d62-acad-c6e9a7a7225e" status: 200 len: 1522 microversion: 2.1 time: 0.151391 Jul 28 05:33:09.188229 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 121/240] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:33:09 2022] GET /compute/v2.1/servers/d70d71f4-de27-4d62-acad-c6e9a7a7225e => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:33:10.208210 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-be69370d-e10c-4018-a881-e542091dbfce tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:10.208892 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-be69370d-e10c-4018-a881-e542091dbfce tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: d70d71f4-de27-4d62-acad-c6e9a7a7225e] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:10.215691 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-be69370d-e10c-4018-a881-e542091dbfce tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:10.216132 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-be69370d-e10c-4018-a881-e542091dbfce tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:10.216890 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-be69370d-e10c-4018-a881-e542091dbfce tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:10.217320 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-be69370d-e10c-4018-a881-e542091dbfce tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:10.355578 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-be69370d-e10c-4018-a881-e542091dbfce tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:10.363825 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-be69370d-e10c-4018-a881-e542091dbfce tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/d70d71f4-de27-4d62-acad-c6e9a7a7225e" status: 200 len: 1522 microversion: 2.1 time: 0.159665 Jul 28 05:33:10.364406 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 120/241] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:33:10 2022] GET /compute/v2.1/servers/d70d71f4-de27-4d62-acad-c6e9a7a7225e => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:33:11.385292 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-e9ac5c92-8745-42a0-8b81-a70691cca841 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:11.386050 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-e9ac5c92-8745-42a0-8b81-a70691cca841 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: d70d71f4-de27-4d62-acad-c6e9a7a7225e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:11.392108 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e9ac5c92-8745-42a0-8b81-a70691cca841 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:11.392648 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e9ac5c92-8745-42a0-8b81-a70691cca841 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:11.393529 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e9ac5c92-8745-42a0-8b81-a70691cca841 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:11.393946 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e9ac5c92-8745-42a0-8b81-a70691cca841 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:11.529769 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-e9ac5c92-8745-42a0-8b81-a70691cca841 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:11.537371 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-e9ac5c92-8745-42a0-8b81-a70691cca841 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/d70d71f4-de27-4d62-acad-c6e9a7a7225e" status: 200 len: 1522 microversion: 2.1 time: 0.155895 Jul 28 05:33:11.537975 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 122/242] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:33:11 2022] GET /compute/v2.1/servers/d70d71f4-de27-4d62-acad-c6e9a7a7225e => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:33:12.559303 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-ad87c7f5-c84b-4424-8829-4b3b4a83f0bc tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:12.560654 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-ad87c7f5-c84b-4424-8829-4b3b4a83f0bc tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: d70d71f4-de27-4d62-acad-c6e9a7a7225e] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:12.567331 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-ad87c7f5-c84b-4424-8829-4b3b4a83f0bc tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:12.567777 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-ad87c7f5-c84b-4424-8829-4b3b4a83f0bc tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:12.568568 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-ad87c7f5-c84b-4424-8829-4b3b4a83f0bc tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:12.569006 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-ad87c7f5-c84b-4424-8829-4b3b4a83f0bc tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:12.702261 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-ad87c7f5-c84b-4424-8829-4b3b4a83f0bc tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:12.709656 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-ad87c7f5-c84b-4424-8829-4b3b4a83f0bc tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/d70d71f4-de27-4d62-acad-c6e9a7a7225e" status: 200 len: 1522 microversion: 2.1 time: 0.154339 Jul 28 05:33:12.710231 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 121/243] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:33:12 2022] GET /compute/v2.1/servers/d70d71f4-de27-4d62-acad-c6e9a7a7225e => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:33:13.731815 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-ce4d8e23-a4e5-40cb-9233-35b18a84bc9c tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:13.732352 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-ce4d8e23-a4e5-40cb-9233-35b18a84bc9c tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: d70d71f4-de27-4d62-acad-c6e9a7a7225e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:13.738617 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ce4d8e23-a4e5-40cb-9233-35b18a84bc9c tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:13.739059 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ce4d8e23-a4e5-40cb-9233-35b18a84bc9c tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:13.739813 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ce4d8e23-a4e5-40cb-9233-35b18a84bc9c tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:13.740253 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ce4d8e23-a4e5-40cb-9233-35b18a84bc9c tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:13.873652 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-ce4d8e23-a4e5-40cb-9233-35b18a84bc9c tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:13.881129 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-ce4d8e23-a4e5-40cb-9233-35b18a84bc9c tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/d70d71f4-de27-4d62-acad-c6e9a7a7225e" status: 200 len: 1522 microversion: 2.1 time: 0.153345 Jul 28 05:33:13.881748 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 123/244] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:33:13 2022] GET /compute/v2.1/servers/d70d71f4-de27-4d62-acad-c6e9a7a7225e => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:33:14.902763 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-25669e61-24b2-4f14-bd92-5c565922953d tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:14.903416 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-25669e61-24b2-4f14-bd92-5c565922953d tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: d70d71f4-de27-4d62-acad-c6e9a7a7225e] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:14.910040 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-25669e61-24b2-4f14-bd92-5c565922953d tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:14.916367 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-25669e61-24b2-4f14-bd92-5c565922953d tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:14.916367 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-25669e61-24b2-4f14-bd92-5c565922953d tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:14.916367 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-25669e61-24b2-4f14-bd92-5c565922953d tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:15.050047 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-25669e61-24b2-4f14-bd92-5c565922953d tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:15.057718 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-25669e61-24b2-4f14-bd92-5c565922953d tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/d70d71f4-de27-4d62-acad-c6e9a7a7225e" status: 200 len: 1522 microversion: 2.1 time: 0.159159 Jul 28 05:33:15.058303 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 122/245] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:33:14 2022] GET /compute/v2.1/servers/d70d71f4-de27-4d62-acad-c6e9a7a7225e => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:33:16.079218 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-c2a3b3f8-1772-490b-bf41-df6393cff8ae tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:16.079753 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-c2a3b3f8-1772-490b-bf41-df6393cff8ae tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: d70d71f4-de27-4d62-acad-c6e9a7a7225e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:16.085995 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c2a3b3f8-1772-490b-bf41-df6393cff8ae tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:16.086484 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c2a3b3f8-1772-490b-bf41-df6393cff8ae tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:16.087337 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c2a3b3f8-1772-490b-bf41-df6393cff8ae tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:16.087777 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c2a3b3f8-1772-490b-bf41-df6393cff8ae tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:16.228272 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-c2a3b3f8-1772-490b-bf41-df6393cff8ae tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:16.236036 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-c2a3b3f8-1772-490b-bf41-df6393cff8ae tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/d70d71f4-de27-4d62-acad-c6e9a7a7225e" status: 200 len: 1502 microversion: 2.1 time: 0.160805 Jul 28 05:33:16.236619 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 124/246] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:33:16 2022] GET /compute/v2.1/servers/d70d71f4-de27-4d62-acad-c6e9a7a7225e => generated 1502 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:33:16.256919 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-5c235aa5-0ad6-4feb-a51d-b42f61578317 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "be4e92e5-01fb-4188-b50b-a75e9df6b7b2"}} {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:33:16.259402 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-5c235aa5-0ad6-4feb-a51d-b42f61578317 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: d70d71f4-de27-4d62-acad-c6e9a7a7225e] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:16.267004 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-5c235aa5-0ad6-4feb-a51d-b42f61578317 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:16.267460 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-5c235aa5-0ad6-4feb-a51d-b42f61578317 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:16.268247 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-5c235aa5-0ad6-4feb-a51d-b42f61578317 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:16.268680 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-5c235aa5-0ad6-4feb-a51d-b42f61578317 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:16.294150 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.wsgi [None req-5c235aa5-0ad6-4feb-a51d-b42f61578317 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] HTTP exception thrown: Cannot 'attach_volume' instance d70d71f4-de27-4d62-acad-c6e9a7a7225e while it is in vm_state rescued Jul 28 05:33:16.295932 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-5c235aa5-0ad6-4feb-a51d-b42f61578317 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Request method failure captured: Jul 28 05:33:16.295932 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: request: POST /compute/v2.1/servers/d70d71f4-de27-4d62-acad-c6e9a7a7225e/os-volume_attachments HTTP/1.1 Jul 28 05:33:16.295932 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Accept: application/json Jul 28 05:33:16.295932 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Accept-Encoding: identity Jul 28 05:33:16.295932 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Connection: close Jul 28 05:33:16.295932 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Content-Length: 74 Jul 28 05:33:16.295932 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Content-Type: application/json Jul 28 05:33:16.295932 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Host: 10.222.0.33 Jul 28 05:33:16.295932 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Openstack-System-Scope: None Jul 28 05:33:16.295932 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: User-Agent: python-urllib3/1.26.10 Jul 28 05:33:16.295932 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Auth-Token: gAAAAABi4h84wg4qlFIi1MM6witAk51FDE4BLzXqxMfe6k0jq8CFmcbtqdoBS3AevDrKaw3dmOujUkImtAsInpNCwgYRxMei_nfojXNroWNTr6vsZakpdR__3W76-XDu4xyFhZj-aUFliI2k9fmeYH-hK9oTm36uOAQrbt51a7XSRrj7_QKgyu0 Jul 28 05:33:16.295932 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Domain-Id: None Jul 28 05:33:16.295932 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Domain-Name: None Jul 28 05:33:16.295932 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Identity-Status: Confirmed Jul 28 05:33:16.295932 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Is-Admin-Project: True Jul 28 05:33:16.295932 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Project-Domain-Id: default Jul 28 05:33:16.295932 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Project-Domain-Name: Default Jul 28 05:33:16.295932 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Project-Id: 99f094bca18d4939bb22f8d076d3a35c Jul 28 05:33:16.295932 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1728283555 Jul 28 05:33:16.295932 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Role: member,reader Jul 28 05:33:16.295932 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Roles: member,reader Jul 28 05:33:16.297397 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/99f094bca18d4939bb22f8d076d3a35c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/99f094bca18d4939bb22f8d076d3a35c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_99f094bca18d4939bb22f8d076d3a35c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/99f094bca18d4939bb22f8d076d3a35c"}]}] Jul 28 05:33:16.297397 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1728283555 Jul 28 05:33:16.297397 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Tenant-Id: 99f094bca18d4939bb22f8d076d3a35c Jul 28 05:33:16.297397 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1728283555 Jul 28 05:33:16.297397 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-User: tempest-ServerRescueNegativeTestJSON-1728283555-project Jul 28 05:33:16.297397 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-User-Domain-Id: default Jul 28 05:33:16.297397 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-User-Domain-Name: Default Jul 28 05:33:16.297397 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-User-Id: 4fcc81558e8f4224ad2ea6fb2b7bf0f9 Jul 28 05:33:16.297397 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1728283555-project Jul 28 05:33:16.297397 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Jul 28 05:33:16.297397 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: {"volumeAttachment": {"volumeId": "be4e92e5-01fb-4188-b50b-a75e9df6b7b2"}} Jul 28 05:33:16.297397 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: method: > Jul 28 05:33:16.298284 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: exception: Cannot 'attach_volume' instance d70d71f4-de27-4d62-acad-c6e9a7a7225e while it is in vm_state rescued Jul 28 05:33:16.298284 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: action_args: {'server_id': 'd70d71f4-de27-4d62-acad-c6e9a7a7225e', 'body': {'volumeAttachment': {'volumeId': 'be4e92e5-01fb-4188-b50b-a75e9df6b7b2'}}} Jul 28 05:33:16.298284 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 05:33:16.298284 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:33:16.298284 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 28 05:33:16.298284 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 28 05:33:16.298284 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 05:33:16.298284 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 05:33:16.298284 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Jul 28 05:33:16.298284 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 28 05:33:16.298284 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d70d71f4-de27-4d62-acad-c6e9a7a7225e in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 28 05:33:16.298284 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Jul 28 05:33:16.298284 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:33:16.298284 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Jul 28 05:33:16.298284 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:33:16.298284 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:33:16.298284 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:33:16.298284 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 05:33:16.298284 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 05:33:16.302948 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 05:33:16.302948 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:33:16.302948 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 05:33:16.302948 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 05:33:16.302948 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 05:33:16.302948 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 05:33:16.302948 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 05:33:16.302948 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 05:33:16.302948 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 28 05:33:16.302948 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 28 05:33:16.302948 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 28 05:33:16.302948 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 28 05:33:16.302948 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance d70d71f4-de27-4d62-acad-c6e9a7a7225e while it is in vm_state rescued Jul 28 05:33:16.302948 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Jul 28 05:33:16.302948 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:33:16.302948 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Jul 28 05:33:16.302948 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:33:16.302948 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:33:16.302948 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:33:16.304143 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 05:33:16.304143 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 05:33:16.304143 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance d70d71f4-de27-4d62-acad-c6e9a7a7225e while it is in vm_state rescued Jul 28 05:33:16.304143 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: ERROR nova.api.openstack.wsgi Jul 28 05:33:16.304143 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-5c235aa5-0ad6-4feb-a51d-b42f61578317 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Returning 409 to user: Cannot 'attach_volume' instance d70d71f4-de27-4d62-acad-c6e9a7a7225e while it is in vm_state rescued {{(pid=124483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 05:33:16.304143 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-5c235aa5-0ad6-4feb-a51d-b42f61578317 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "POST /compute/v2.1/servers/d70d71f4-de27-4d62-acad-c6e9a7a7225e/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.044611 Jul 28 05:33:16.304143 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 123/247] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Jul 28 05:33:16 2022] POST /compute/v2.1/servers/d70d71f4-de27-4d62-acad-c6e9a7a7225e/os-volume_attachments => generated 152 bytes in 46 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 28 05:33:16.310354 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-2b2a0efa-06d2-4848-a010-577276da7b89 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:33:16.310890 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-2b2a0efa-06d2-4848-a010-577276da7b89 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: d70d71f4-de27-4d62-acad-c6e9a7a7225e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:16.316835 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2b2a0efa-06d2-4848-a010-577276da7b89 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:16.317284 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2b2a0efa-06d2-4848-a010-577276da7b89 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:16.318157 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2b2a0efa-06d2-4848-a010-577276da7b89 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:16.318593 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2b2a0efa-06d2-4848-a010-577276da7b89 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:16.492900 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-2b2a0efa-06d2-4848-a010-577276da7b89 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "POST /compute/v2.1/servers/d70d71f4-de27-4d62-acad-c6e9a7a7225e/action" status: 202 len: 0 microversion: 2.1 time: 0.186714 Jul 28 05:33:16.494672 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 125/248] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Jul 28 05:33:16 2022] POST /compute/v2.1/servers/d70d71f4-de27-4d62-acad-c6e9a7a7225e/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 05:33:16.502543 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-39b41fc4-6cc9-4e15-a57e-948d7f0d4a4a tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:16.503149 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-39b41fc4-6cc9-4e15-a57e-948d7f0d4a4a tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: d70d71f4-de27-4d62-acad-c6e9a7a7225e] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:16.509155 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-39b41fc4-6cc9-4e15-a57e-948d7f0d4a4a tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:16.511946 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-39b41fc4-6cc9-4e15-a57e-948d7f0d4a4a tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:16.511946 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-39b41fc4-6cc9-4e15-a57e-948d7f0d4a4a tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:16.511946 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-39b41fc4-6cc9-4e15-a57e-948d7f0d4a4a tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:16.690572 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-39b41fc4-6cc9-4e15-a57e-948d7f0d4a4a tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:16.698144 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-39b41fc4-6cc9-4e15-a57e-948d7f0d4a4a tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/d70d71f4-de27-4d62-acad-c6e9a7a7225e" status: 200 len: 1510 microversion: 2.1 time: 0.199507 Jul 28 05:33:16.698715 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 124/249] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:33:16 2022] GET /compute/v2.1/servers/d70d71f4-de27-4d62-acad-c6e9a7a7225e => generated 1510 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:33:17.720665 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-d662f250-e3a8-479c-a6a6-a347ddb322aa tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:17.721407 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-d662f250-e3a8-479c-a6a6-a347ddb322aa tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: d70d71f4-de27-4d62-acad-c6e9a7a7225e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:17.727936 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d662f250-e3a8-479c-a6a6-a347ddb322aa tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:17.728379 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d662f250-e3a8-479c-a6a6-a347ddb322aa tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:17.729146 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d662f250-e3a8-479c-a6a6-a347ddb322aa tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:17.729619 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d662f250-e3a8-479c-a6a6-a347ddb322aa tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:17.866397 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-d662f250-e3a8-479c-a6a6-a347ddb322aa tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:17.874422 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-d662f250-e3a8-479c-a6a6-a347ddb322aa tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/d70d71f4-de27-4d62-acad-c6e9a7a7225e" status: 200 len: 1510 microversion: 2.1 time: 0.157942 Jul 28 05:33:17.874992 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 126/250] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:33:17 2022] GET /compute/v2.1/servers/d70d71f4-de27-4d62-acad-c6e9a7a7225e => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:33:18.895986 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-ed27e8ab-de5f-49a1-adcc-ee57bff1136c tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:18.896523 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-ed27e8ab-de5f-49a1-adcc-ee57bff1136c tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: d70d71f4-de27-4d62-acad-c6e9a7a7225e] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:18.903622 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-ed27e8ab-de5f-49a1-adcc-ee57bff1136c tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:18.904065 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-ed27e8ab-de5f-49a1-adcc-ee57bff1136c tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:18.904821 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-ed27e8ab-de5f-49a1-adcc-ee57bff1136c tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:18.905257 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-ed27e8ab-de5f-49a1-adcc-ee57bff1136c tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:19.034683 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-ed27e8ab-de5f-49a1-adcc-ee57bff1136c tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:19.042823 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-ed27e8ab-de5f-49a1-adcc-ee57bff1136c tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/d70d71f4-de27-4d62-acad-c6e9a7a7225e" status: 200 len: 1510 microversion: 2.1 time: 0.151112 Jul 28 05:33:19.043419 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 125/251] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:33:18 2022] GET /compute/v2.1/servers/d70d71f4-de27-4d62-acad-c6e9a7a7225e => generated 1510 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:33:20.064750 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-774eaa45-6447-4f47-a210-95a27bf1889a tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:20.065379 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-774eaa45-6447-4f47-a210-95a27bf1889a tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: d70d71f4-de27-4d62-acad-c6e9a7a7225e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:20.071421 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-774eaa45-6447-4f47-a210-95a27bf1889a tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:20.071872 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-774eaa45-6447-4f47-a210-95a27bf1889a tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:20.072631 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-774eaa45-6447-4f47-a210-95a27bf1889a tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:20.073068 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-774eaa45-6447-4f47-a210-95a27bf1889a tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:20.205996 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-774eaa45-6447-4f47-a210-95a27bf1889a tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:20.213347 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-774eaa45-6447-4f47-a210-95a27bf1889a tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/d70d71f4-de27-4d62-acad-c6e9a7a7225e" status: 200 len: 1516 microversion: 2.1 time: 0.152482 Jul 28 05:33:20.213962 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 127/252] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:33:20 2022] GET /compute/v2.1/servers/d70d71f4-de27-4d62-acad-c6e9a7a7225e => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:33:21.237872 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-7ae04d44-4c77-4383-b9ab-1b0be994c327 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:21.238417 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-7ae04d44-4c77-4383-b9ab-1b0be994c327 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:21.244722 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-7ae04d44-4c77-4383-b9ab-1b0be994c327 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:21.245176 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-7ae04d44-4c77-4383-b9ab-1b0be994c327 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:21.245972 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-7ae04d44-4c77-4383-b9ab-1b0be994c327 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:21.246952 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-7ae04d44-4c77-4383-b9ab-1b0be994c327 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:21.273501 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-7ae04d44-4c77-4383-b9ab-1b0be994c327 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5/ips" status: 200 len: 151 microversion: 2.20 time: 0.039157 Jul 28 05:33:21.274403 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 126/253] 10.222.0.33 () {60 vars in 1289 bytes} [Thu Jul 28 05:33:21 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 05:33:21.838395 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-4e50cc07-9a32-4d32-8f14-a5a03723cabf tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Action: 'create', calling method: .version_select at 0x7f25e051b280>, body: {"keypair": {"name": "tempest-keypair-2068912648", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsO7SaZdJO3hMGNhi5lv5DxegLJNVKMGRGwYOpTCbkFR7oRY0WItszmfwhkYtDXhOWuOO5h8S3V26ug5QgqRPn4DpnI2V5ff1fU53I8dD7bbx9P/9KSwnYn0n2A7stKoA=="}} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:33:21.858644 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.quota [None req-4e50cc07-9a32-4d32-8f14-a5a03723cabf tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Getting quotas for project 99f094bca18d4939bb22f8d076d3a35c. Resources: {'key_pairs'} {{(pid=124482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 05:33:21.862642 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.quota [None req-4e50cc07-9a32-4d32-8f14-a5a03723cabf tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Getting quotas for user 4fcc81558e8f4224ad2ea6fb2b7bf0f9 and project 99f094bca18d4939bb22f8d076d3a35c. Resources: {'key_pairs'} {{(pid=124482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 05:33:21.988010 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-4e50cc07-9a32-4d32-8f14-a5a03723cabf tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.153526 Jul 28 05:33:21.989509 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 128/254] 10.222.0.33 () {60 vars in 1159 bytes} [Thu Jul 28 05:33:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:33:24.204878 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-e72fbfcb-4301-4b75-9023-8beb1ea36253 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1322673971", "imageRef": "4f0ce061-6677-4c2a-9ee1-54a100f21462", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "11838418-6b14-40b8-a589-613bdb83fff4"}], "security_groups": [{"name": "tempest-securitygroup--1818056971"}], "key_name": "tempest-keypair-2068912648", "user_data": "}} {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:33:24.317923 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.network.neutron [None req-e72fbfcb-4301-4b75-9023-8beb1ea36253 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] validate_networks() for [('11838418-6b14-40b8-a589-613bdb83fff4', None, None, None, None, None)] {{(pid=124483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 05:33:24.687352 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.virt.hardware [None req-e72fbfcb-4301-4b75-9023-8beb1ea36253 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Flavor limits 0:0:0 {{(pid=124483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 05:33:24.687779 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.virt.hardware [None req-e72fbfcb-4301-4b75-9023-8beb1ea36253 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Image limits 0:0:0 {{(pid=124483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 05:33:24.688281 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.virt.hardware [None req-e72fbfcb-4301-4b75-9023-8beb1ea36253 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Flavor pref 0:0:0 {{(pid=124483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 05:33:24.688693 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.virt.hardware [None req-e72fbfcb-4301-4b75-9023-8beb1ea36253 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Image pref 0:0:0 {{(pid=124483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 05:33:24.689126 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.virt.hardware [None req-e72fbfcb-4301-4b75-9023-8beb1ea36253 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 05:33:24.698052 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-e72fbfcb-4301-4b75-9023-8beb1ea36253 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:24.698501 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-e72fbfcb-4301-4b75-9023-8beb1ea36253 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:24.699336 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-e72fbfcb-4301-4b75-9023-8beb1ea36253 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:24.699743 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-e72fbfcb-4301-4b75-9023-8beb1ea36253 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:24.716990 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.quota [None req-e72fbfcb-4301-4b75-9023-8beb1ea36253 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Getting quotas for project 99f094bca18d4939bb22f8d076d3a35c. Resources: {'ram', 'instances', 'cores'} {{(pid=124483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 05:33:24.720979 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.quota [None req-e72fbfcb-4301-4b75-9023-8beb1ea36253 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Getting quotas for user 4fcc81558e8f4224ad2ea6fb2b7bf0f9 and project 99f094bca18d4939bb22f8d076d3a35c. Resources: {'ram', 'instances', 'cores'} {{(pid=124483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 05:33:24.732741 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-e72fbfcb-4301-4b75-9023-8beb1ea36253 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Going to run 1 instances... {{(pid=124483) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 05:33:24.735019 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-e72fbfcb-4301-4b75-9023-8beb1ea36253 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f0ce061-6677-4c2a-9ee1-54a100f21462',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 05:33:24.839887 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-e72fbfcb-4301-4b75-9023-8beb1ea36253 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.640079 Jul 28 05:33:24.840545 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 127/255] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Jul 28 05:33:24 2022] POST /compute/v2.1/servers => generated 409 bytes in 641 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 05:33:24.851879 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-7573ade4-f0b9-4ddc-a3c5-ace98a2c63a7 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:24.852504 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-7573ade4-f0b9-4ddc-a3c5-ace98a2c63a7 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:24.910286 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-7573ade4-f0b9-4ddc-a3c5-ace98a2c63a7 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:24.918623 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-7573ade4-f0b9-4ddc-a3c5-ace98a2c63a7 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9" status: 200 len: 1246 microversion: 2.1 time: 0.070220 Jul 28 05:33:24.919202 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 129/256] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:33:24 2022] GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 => generated 1246 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:33:25.940826 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-e58690ff-b660-4800-9a77-9994ac841f90 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:25.941524 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-e58690ff-b660-4800-9a77-9994ac841f90 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:25.948252 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-e58690ff-b660-4800-9a77-9994ac841f90 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:25.948721 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-e58690ff-b660-4800-9a77-9994ac841f90 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:25.949493 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-e58690ff-b660-4800-9a77-9994ac841f90 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:25.949986 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-e58690ff-b660-4800-9a77-9994ac841f90 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:26.009430 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-e58690ff-b660-4800-9a77-9994ac841f90 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:26.017110 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-e58690ff-b660-4800-9a77-9994ac841f90 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9" status: 200 len: 1250 microversion: 2.1 time: 0.080997 Jul 28 05:33:26.017799 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 128/257] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:33:25 2022] GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 => generated 1250 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:33:26.083234 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-ecd9266b-b4a1-4435-828e-51862a327f7e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:33:26.083759 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-ecd9266b-b4a1-4435-828e-51862a327f7e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:26.085714 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=1 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:33:26.095617 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ecd9266b-b4a1-4435-828e-51862a327f7e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:26.095617 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ecd9266b-b4a1-4435-828e-51862a327f7e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:26.095617 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ecd9266b-b4a1-4435-828e-51862a327f7e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:26.095617 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ecd9266b-b4a1-4435-828e-51862a327f7e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:26.116214 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.objects.instance [None req-ecd9266b-b4a1-4435-828e-51862a327f7e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lazy-loading 'flavor' on Instance uuid 57115a26-af82-499e-a831-4b4c40e60ac5 {{(pid=124482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 05:33:26.218326 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:33:26.579945 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-ecd9266b-b4a1-4435-828e-51862a327f7e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "POST /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5/action" status: 202 len: 0 microversion: 2.20 time: 0.500567 Jul 28 05:33:26.580529 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 130/258] 10.222.0.33 () {62 vars in 1319 bytes} [Thu Jul 28 05:33:26 2022] POST /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5/action => generated 0 bytes in 502 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 05:33:26.588745 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-576ef70f-5e2e-4658-9e16-d2f7a19be378 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:26.592696 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-576ef70f-5e2e-4658-9e16-d2f7a19be378 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:26.596711 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-576ef70f-5e2e-4658-9e16-d2f7a19be378 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:26.597168 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-576ef70f-5e2e-4658-9e16-d2f7a19be378 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:26.597967 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-576ef70f-5e2e-4658-9e16-d2f7a19be378 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:26.598402 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-576ef70f-5e2e-4658-9e16-d2f7a19be378 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:26.730671 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-576ef70f-5e2e-4658-9e16-d2f7a19be378 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:26.738593 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-576ef70f-5e2e-4658-9e16-d2f7a19be378 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:26.740129 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-576ef70f-5e2e-4658-9e16-d2f7a19be378 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:26.741278 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-576ef70f-5e2e-4658-9e16-d2f7a19be378 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1722 microversion: 2.20 time: 0.156459 Jul 28 05:33:26.741873 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 129/259] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:33:26 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:33:27.038549 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-3f97378b-62e4-47db-9ce7-01e3b3595448 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:27.039277 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-3f97378b-62e4-47db-9ce7-01e3b3595448 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:27.045537 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3f97378b-62e4-47db-9ce7-01e3b3595448 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:27.052744 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3f97378b-62e4-47db-9ce7-01e3b3595448 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:27.052744 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3f97378b-62e4-47db-9ce7-01e3b3595448 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:27.052744 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3f97378b-62e4-47db-9ce7-01e3b3595448 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:27.108558 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-3f97378b-62e4-47db-9ce7-01e3b3595448 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:27.116052 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-3f97378b-62e4-47db-9ce7-01e3b3595448 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9" status: 200 len: 1250 microversion: 2.1 time: 0.081718 Jul 28 05:33:27.116609 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 131/260] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:33:27 2022] GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 => generated 1250 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:33:27.764235 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-61530afa-c0c2-4f60-8902-ebd1c3f96153 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:27.764848 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-61530afa-c0c2-4f60-8902-ebd1c3f96153 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:27.771503 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-61530afa-c0c2-4f60-8902-ebd1c3f96153 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:27.772090 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-61530afa-c0c2-4f60-8902-ebd1c3f96153 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:27.773100 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-61530afa-c0c2-4f60-8902-ebd1c3f96153 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:27.773574 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-61530afa-c0c2-4f60-8902-ebd1c3f96153 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:28.042556 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-61530afa-c0c2-4f60-8902-ebd1c3f96153 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:28.051296 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-61530afa-c0c2-4f60-8902-ebd1c3f96153 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:28.052822 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-61530afa-c0c2-4f60-8902-ebd1c3f96153 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:28.054009 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-61530afa-c0c2-4f60-8902-ebd1c3f96153 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1722 microversion: 2.20 time: 0.293742 Jul 28 05:33:28.054570 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 130/261] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:33:27 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1722 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:33:28.137506 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-545abdfa-6baf-44e3-bcdd-8642c154126a tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:28.138197 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-545abdfa-6baf-44e3-bcdd-8642c154126a tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:28.144298 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-545abdfa-6baf-44e3-bcdd-8642c154126a tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:28.144745 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-545abdfa-6baf-44e3-bcdd-8642c154126a tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:28.145512 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-545abdfa-6baf-44e3-bcdd-8642c154126a tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:28.145955 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-545abdfa-6baf-44e3-bcdd-8642c154126a tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:28.210146 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-545abdfa-6baf-44e3-bcdd-8642c154126a tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:28.218207 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-545abdfa-6baf-44e3-bcdd-8642c154126a tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9" status: 200 len: 1242 microversion: 2.1 time: 0.084732 Jul 28 05:33:28.218778 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 132/262] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:33:28 2022] GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 => generated 1242 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:33:28.610205 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-e0114f61-3a5a-413a-b271-b8cf0d31bacf tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:28.610704 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-e0114f61-3a5a-413a-b271-b8cf0d31bacf tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: f769843b-cb4a-4599-bf54-49d579601a8a] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:28.616809 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-e0114f61-3a5a-413a-b271-b8cf0d31bacf tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:28.617374 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-e0114f61-3a5a-413a-b271-b8cf0d31bacf tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:28.618192 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-e0114f61-3a5a-413a-b271-b8cf0d31bacf tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:28.618627 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-e0114f61-3a5a-413a-b271-b8cf0d31bacf tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:28.641993 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-e0114f61-3a5a-413a-b271-b8cf0d31bacf tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a/ips" status: 200 len: 150 microversion: 2.1 time: 0.035617 Jul 28 05:33:28.642546 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 131/263] 10.222.0.33 () {58 vars in 1248 bytes} [Thu Jul 28 05:33:28 2022] GET /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:33:29.078783 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-e196f35b-3325-4310-8763-566245d2b3a5 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:29.079391 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-e196f35b-3325-4310-8763-566245d2b3a5 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:29.085555 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e196f35b-3325-4310-8763-566245d2b3a5 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:29.086008 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e196f35b-3325-4310-8763-566245d2b3a5 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:29.086859 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e196f35b-3325-4310-8763-566245d2b3a5 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:29.087298 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e196f35b-3325-4310-8763-566245d2b3a5 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:29.214209 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-e196f35b-3325-4310-8763-566245d2b3a5 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:29.222906 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-e196f35b-3325-4310-8763-566245d2b3a5 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:29.224467 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-e196f35b-3325-4310-8763-566245d2b3a5 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:29.225656 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-e196f35b-3325-4310-8763-566245d2b3a5 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1722 microversion: 2.20 time: 0.150874 Jul 28 05:33:29.226209 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 133/264] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:33:29 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:33:29.239480 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-cc46ad2a-e01d-473e-a876-5f5727988600 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:29.240090 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-cc46ad2a-e01d-473e-a876-5f5727988600 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:29.246722 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-cc46ad2a-e01d-473e-a876-5f5727988600 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:29.247177 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-cc46ad2a-e01d-473e-a876-5f5727988600 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:29.248026 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-cc46ad2a-e01d-473e-a876-5f5727988600 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:29.248369 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-cc46ad2a-e01d-473e-a876-5f5727988600 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:29.311193 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-cc46ad2a-e01d-473e-a876-5f5727988600 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:29.319169 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-cc46ad2a-e01d-473e-a876-5f5727988600 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9" status: 200 len: 1298 microversion: 2.1 time: 0.083705 Jul 28 05:33:29.319742 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 132/265] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:33:29 2022] GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 => generated 1298 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:33:30.248839 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-aa72b33b-547f-4d23-95e9-800bc94a8f83 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:30.249395 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-aa72b33b-547f-4d23-95e9-800bc94a8f83 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:30.255442 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-aa72b33b-547f-4d23-95e9-800bc94a8f83 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:30.255882 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-aa72b33b-547f-4d23-95e9-800bc94a8f83 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:30.256629 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-aa72b33b-547f-4d23-95e9-800bc94a8f83 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:30.257057 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-aa72b33b-547f-4d23-95e9-800bc94a8f83 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:30.340225 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-03d610a7-0bb8-4846-bc40-a7df370c83d6 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:30.340942 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-03d610a7-0bb8-4846-bc40-a7df370c83d6 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:30.347576 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-03d610a7-0bb8-4846-bc40-a7df370c83d6 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:30.348028 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-03d610a7-0bb8-4846-bc40-a7df370c83d6 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:30.348798 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-03d610a7-0bb8-4846-bc40-a7df370c83d6 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:30.349231 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-03d610a7-0bb8-4846-bc40-a7df370c83d6 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:30.401414 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-aa72b33b-547f-4d23-95e9-800bc94a8f83 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:30.418555 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-aa72b33b-547f-4d23-95e9-800bc94a8f83 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:30.418555 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-aa72b33b-547f-4d23-95e9-800bc94a8f83 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:30.418555 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-aa72b33b-547f-4d23-95e9-800bc94a8f83 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1722 microversion: 2.20 time: 0.168750 Jul 28 05:33:30.419181 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 134/266] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:33:30 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:33:30.419272 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-03d610a7-0bb8-4846-bc40-a7df370c83d6 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:30.425694 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-03d610a7-0bb8-4846-bc40-a7df370c83d6 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9" status: 200 len: 1298 microversion: 2.1 time: 0.089778 Jul 28 05:33:30.426249 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 133/267] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:33:30 2022] GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 => generated 1298 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:33:30.717028 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-d13722eb-1a6a-4376-ae2c-e832b49f9e27 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:30.717538 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-d13722eb-1a6a-4376-ae2c-e832b49f9e27 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:30.723489 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d13722eb-1a6a-4376-ae2c-e832b49f9e27 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:30.723928 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d13722eb-1a6a-4376-ae2c-e832b49f9e27 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:30.724694 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d13722eb-1a6a-4376-ae2c-e832b49f9e27 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:30.725115 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d13722eb-1a6a-4376-ae2c-e832b49f9e27 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:30.748062 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-d13722eb-1a6a-4376-ae2c-e832b49f9e27 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268/ips" status: 200 len: 146 microversion: 2.1 time: 0.035450 Jul 28 05:33:30.748612 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 135/268] 10.222.0.33 () {58 vars in 1248 bytes} [Thu Jul 28 05:33:30 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268/ips => generated 146 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:33:31.440191 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-258650f1-380f-4109-9c1a-a18e20552b37 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:31.440804 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-258650f1-380f-4109-9c1a-a18e20552b37 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:31.446978 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-e6bf91ec-ccc7-4ce8-97fc-6cc00781f9ee tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:31.447516 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-258650f1-380f-4109-9c1a-a18e20552b37 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:31.447637 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-e6bf91ec-ccc7-4ce8-97fc-6cc00781f9ee tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:31.447960 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-258650f1-380f-4109-9c1a-a18e20552b37 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:31.448729 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-258650f1-380f-4109-9c1a-a18e20552b37 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:31.449273 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-258650f1-380f-4109-9c1a-a18e20552b37 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:31.453924 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e6bf91ec-ccc7-4ce8-97fc-6cc00781f9ee tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:31.454562 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e6bf91ec-ccc7-4ce8-97fc-6cc00781f9ee tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:31.455512 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e6bf91ec-ccc7-4ce8-97fc-6cc00781f9ee tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:31.456116 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e6bf91ec-ccc7-4ce8-97fc-6cc00781f9ee tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:31.535188 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-e6bf91ec-ccc7-4ce8-97fc-6cc00781f9ee tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:31.542503 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-e6bf91ec-ccc7-4ce8-97fc-6cc00781f9ee tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9" status: 200 len: 1298 microversion: 2.1 time: 0.099422 Jul 28 05:33:31.543675 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 136/269] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:33:31 2022] GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 => generated 1298 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:33:31.600076 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-258650f1-380f-4109-9c1a-a18e20552b37 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:31.608679 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-258650f1-380f-4109-9c1a-a18e20552b37 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:31.610433 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-258650f1-380f-4109-9c1a-a18e20552b37 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:31.611592 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-258650f1-380f-4109-9c1a-a18e20552b37 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1722 microversion: 2.20 time: 0.175361 Jul 28 05:33:31.612154 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 134/270] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:33:31 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:33:32.564061 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-9ad5e2de-4497-46ad-85f1-292e2b190028 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:32.564779 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-9ad5e2de-4497-46ad-85f1-292e2b190028 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:32.570987 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9ad5e2de-4497-46ad-85f1-292e2b190028 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:32.571443 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9ad5e2de-4497-46ad-85f1-292e2b190028 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:32.572375 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9ad5e2de-4497-46ad-85f1-292e2b190028 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:32.572988 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9ad5e2de-4497-46ad-85f1-292e2b190028 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:32.635776 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-986bf13f-368e-4068-bd58-38290bf71bca tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:32.636395 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-986bf13f-368e-4068-bd58-38290bf71bca tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:32.639053 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG dbcounter [-] [124483] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=124483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:33:32.646114 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-986bf13f-368e-4068-bd58-38290bf71bca tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:32.646743 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-986bf13f-368e-4068-bd58-38290bf71bca tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:32.648015 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-986bf13f-368e-4068-bd58-38290bf71bca tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:32.648607 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-986bf13f-368e-4068-bd58-38290bf71bca tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:32.666997 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-9ad5e2de-4497-46ad-85f1-292e2b190028 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:32.676959 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-9ad5e2de-4497-46ad-85f1-292e2b190028 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9" status: 200 len: 1306 microversion: 2.1 time: 0.116662 Jul 28 05:33:32.677670 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 137/271] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:33:32 2022] GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 => generated 1306 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:33:32.850708 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-986bf13f-368e-4068-bd58-38290bf71bca tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:32.859354 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-986bf13f-368e-4068-bd58-38290bf71bca tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:32.860960 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-986bf13f-368e-4068-bd58-38290bf71bca tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:32.862235 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-986bf13f-368e-4068-bd58-38290bf71bca tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1722 microversion: 2.20 time: 0.230532 Jul 28 05:33:32.862792 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 135/272] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:33:32 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1722 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:33:33.242512 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-eaf1b18f-ce59-410e-be4d-e03b0508b557 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fc3b9eea-65d4-4d24-b3db-51644c1ebddd"}} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:33:33.244950 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-eaf1b18f-ce59-410e-be4d-e03b0508b557 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:33.251403 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-eaf1b18f-ce59-410e-be4d-e03b0508b557 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:33.251888 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-eaf1b18f-ce59-410e-be4d-e03b0508b557 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:33.252648 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-eaf1b18f-ce59-410e-be4d-e03b0508b557 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:33.253080 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-eaf1b18f-ce59-410e-be4d-e03b0508b557 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:33.600168 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-739f9a15-4998-40b7-8fab-022a083cd406 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "656850b6-af39-404a-921a-f1cf74d99571"}} {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:33:33.602630 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-739f9a15-4998-40b7-8fab-022a083cd406 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: f769843b-cb4a-4599-bf54-49d579601a8a] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:33.608738 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-739f9a15-4998-40b7-8fab-022a083cd406 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:33.609194 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-739f9a15-4998-40b7-8fab-022a083cd406 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:33.609991 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-739f9a15-4998-40b7-8fab-022a083cd406 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:33.610426 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-739f9a15-4998-40b7-8fab-022a083cd406 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:33.629741 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG dbcounter [-] [124483] Writing DB stats nova_cell1:SELECT=100 {{(pid=124483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:33:34.117029 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-eaf1b18f-ce59-410e-be4d-e03b0508b557 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "POST /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.878333 Jul 28 05:33:34.117885 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 138/273] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Jul 28 05:33:33 2022] POST /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268/os-volume_attachments => generated 194 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:33:34.123952 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-851faec3-6cfb-44cb-9ebd-9c42dc6f0ae2 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:34.124647 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-851faec3-6cfb-44cb-9ebd-9c42dc6f0ae2 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:34.133156 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-851faec3-6cfb-44cb-9ebd-9c42dc6f0ae2 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:34.133663 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-851faec3-6cfb-44cb-9ebd-9c42dc6f0ae2 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:34.134434 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-851faec3-6cfb-44cb-9ebd-9c42dc6f0ae2 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:34.135022 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-851faec3-6cfb-44cb-9ebd-9c42dc6f0ae2 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:34.362360 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-851faec3-6cfb-44cb-9ebd-9c42dc6f0ae2 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:34.371725 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-851faec3-6cfb-44cb-9ebd-9c42dc6f0ae2 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9" status: 200 len: 1372 microversion: 2.1 time: 0.251911 Jul 28 05:33:34.372369 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 139/274] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:33:34 2022] GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 => generated 1372 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:33:34.382677 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-8dd894aa-104d-45c6-877a-45ec196346ae tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:34.394462 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-8dd894aa-104d-45c6-877a-45ec196346ae tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:34.401856 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8dd894aa-104d-45c6-877a-45ec196346ae tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:34.402819 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8dd894aa-104d-45c6-877a-45ec196346ae tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:34.403779 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8dd894aa-104d-45c6-877a-45ec196346ae tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:34.404365 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8dd894aa-104d-45c6-877a-45ec196346ae tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:34.465979 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-739f9a15-4998-40b7-8fab-022a083cd406 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "POST /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.868260 Jul 28 05:33:34.466599 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 136/275] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Jul 28 05:33:33 2022] POST /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a/os-volume_attachments => generated 194 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 05:33:34.762098 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-8ca42c55-2b95-4b2f-a9ed-9ad5baa77073 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4fc14e7a-8a35-448d-86df-70baccd8decf", "device": "/dev/sdb"}} {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:33:34.766600 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-8ca42c55-2b95-4b2f-a9ed-9ad5baa77073 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] [instance: 38be4c9a-b055-46f2-a269-f67214cd08ff] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:34.768872 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG dbcounter [-] [124483] Writing DB stats nova_cell0:SELECT=2 {{(pid=124483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:33:34.775047 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG dbcounter [-] [124483] Writing DB stats nova_cell0:SELECT=6 {{(pid=124483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:33:34.776721 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-8ca42c55-2b95-4b2f-a9ed-9ad5baa77073 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:34.777836 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-8ca42c55-2b95-4b2f-a9ed-9ad5baa77073 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:34.778770 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-8ca42c55-2b95-4b2f-a9ed-9ad5baa77073 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:34.779312 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-8ca42c55-2b95-4b2f-a9ed-9ad5baa77073 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:34.869981 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-8dd894aa-104d-45c6-877a-45ec196346ae tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:34.882319 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-8dd894aa-104d-45c6-877a-45ec196346ae tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:34.885607 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-8dd894aa-104d-45c6-877a-45ec196346ae tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:34.888306 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-8dd894aa-104d-45c6-877a-45ec196346ae tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1722 microversion: 2.20 time: 0.511038 Jul 28 05:33:34.899150 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 140/276] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:33:34 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1722 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:33:35.392702 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-99b28b99-f675-4309-9b67-58a2e4edca2f tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:35.394062 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-99b28b99-f675-4309-9b67-58a2e4edca2f tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:35.396137 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell0:SELECT=6 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:33:35.401411 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-99b28b99-f675-4309-9b67-58a2e4edca2f tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:35.402418 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-99b28b99-f675-4309-9b67-58a2e4edca2f tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:35.403203 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-99b28b99-f675-4309-9b67-58a2e4edca2f tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:35.403855 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-99b28b99-f675-4309-9b67-58a2e4edca2f tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:35.548825 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-99b28b99-f675-4309-9b67-58a2e4edca2f tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:35.559067 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-99b28b99-f675-4309-9b67-58a2e4edca2f tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9" status: 200 len: 1372 microversion: 2.1 time: 0.168573 Jul 28 05:33:35.559067 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 141/277] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:33:35 2022] GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 => generated 1372 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:33:35.576470 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-65e8e4d2-de43-4d07-b222-b5aedc25ec9c req-6808b768-1dfb-4be6-a2a2-367508d2437a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9", "tag": "1507aad5-e944-47e5-a8d9-716f5bde1fff"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:33:35.587804 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-65e8e4d2-de43-4d07-b222-b5aedc25ec9c req-6808b768-1dfb-4be6-a2a2-367508d2437a service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:35.588318 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-65e8e4d2-de43-4d07-b222-b5aedc25ec9c req-6808b768-1dfb-4be6-a2a2-367508d2437a service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:35.600944 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-65e8e4d2-de43-4d07-b222-b5aedc25ec9c req-6808b768-1dfb-4be6-a2a2-367508d2437a service nova] Creating event network-changed:1507aad5-e944-47e5-a8d9-716f5bde1fff for instance 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 on hv-cinder-79987 Jul 28 05:33:35.606509 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-65e8e4d2-de43-4d07-b222-b5aedc25ec9c req-6808b768-1dfb-4be6-a2a2-367508d2437a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047316 Jul 28 05:33:35.607401 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 142/278] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:33:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:33:35.721808 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-8ca42c55-2b95-4b2f-a9ed-9ad5baa77073 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] 10.222.0.33 "POST /compute/v2.1/servers/38be4c9a-b055-46f2-a269-f67214cd08ff/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.964540 Jul 28 05:33:35.723005 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 137/279] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Jul 28 05:33:34 2022] POST /compute/v2.1/servers/38be4c9a-b055-46f2-a269-f67214cd08ff/os-volume_attachments => generated 194 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 05:33:35.915407 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-84cb1c51-ba43-4fda-ab95-69318f4a09d8 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:35.916301 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-84cb1c51-ba43-4fda-ab95-69318f4a09d8 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:35.923122 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-84cb1c51-ba43-4fda-ab95-69318f4a09d8 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:35.923619 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-84cb1c51-ba43-4fda-ab95-69318f4a09d8 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:35.924346 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-84cb1c51-ba43-4fda-ab95-69318f4a09d8 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:35.924775 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-84cb1c51-ba43-4fda-ab95-69318f4a09d8 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:36.094860 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-84cb1c51-ba43-4fda-ab95-69318f4a09d8 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:36.103239 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-84cb1c51-ba43-4fda-ab95-69318f4a09d8 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:36.104749 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-84cb1c51-ba43-4fda-ab95-69318f4a09d8 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:36.105956 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-84cb1c51-ba43-4fda-ab95-69318f4a09d8 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1722 microversion: 2.20 time: 0.194857 Jul 28 05:33:36.107158 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 143/280] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:33:35 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1722 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:33:36.581833 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-f5ff7f9e-6d98-40ba-b44a-8ef70ba40450 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:36.582526 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-f5ff7f9e-6d98-40ba-b44a-8ef70ba40450 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:36.588632 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-f5ff7f9e-6d98-40ba-b44a-8ef70ba40450 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:36.589083 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-f5ff7f9e-6d98-40ba-b44a-8ef70ba40450 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:36.589895 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-f5ff7f9e-6d98-40ba-b44a-8ef70ba40450 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:36.590330 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-f5ff7f9e-6d98-40ba-b44a-8ef70ba40450 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:36.721959 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-f5ff7f9e-6d98-40ba-b44a-8ef70ba40450 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:36.729306 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-f5ff7f9e-6d98-40ba-b44a-8ef70ba40450 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9" status: 200 len: 1372 microversion: 2.1 time: 0.152162 Jul 28 05:33:36.729955 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 138/281] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:33:36 2022] GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:33:37.129233 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-eaa74446-78a1-49a9-b5eb-66f6eaf0b7bf tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:37.129876 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-eaa74446-78a1-49a9-b5eb-66f6eaf0b7bf tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:37.137140 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-eaa74446-78a1-49a9-b5eb-66f6eaf0b7bf tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:37.137679 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-eaa74446-78a1-49a9-b5eb-66f6eaf0b7bf tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:37.138463 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-eaa74446-78a1-49a9-b5eb-66f6eaf0b7bf tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:37.138891 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-eaa74446-78a1-49a9-b5eb-66f6eaf0b7bf tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:37.273238 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-eaa74446-78a1-49a9-b5eb-66f6eaf0b7bf tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:37.281894 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-eaa74446-78a1-49a9-b5eb-66f6eaf0b7bf tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:37.283403 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-eaa74446-78a1-49a9-b5eb-66f6eaf0b7bf tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:37.284564 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-eaa74446-78a1-49a9-b5eb-66f6eaf0b7bf tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1722 microversion: 2.20 time: 0.159197 Jul 28 05:33:37.285203 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 144/282] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:33:37 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:33:37.751409 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-caf64254-5719-4cee-8ebb-0a4d3884f401 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:37.752102 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-caf64254-5719-4cee-8ebb-0a4d3884f401 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:37.758675 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-caf64254-5719-4cee-8ebb-0a4d3884f401 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:37.759194 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-caf64254-5719-4cee-8ebb-0a4d3884f401 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:37.759955 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-caf64254-5719-4cee-8ebb-0a4d3884f401 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:37.760388 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-caf64254-5719-4cee-8ebb-0a4d3884f401 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:37.927906 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-caf64254-5719-4cee-8ebb-0a4d3884f401 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:37.934882 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-caf64254-5719-4cee-8ebb-0a4d3884f401 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9" status: 200 len: 1372 microversion: 2.1 time: 0.187509 Jul 28 05:33:37.935606 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 139/283] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:33:37 2022] GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 => generated 1372 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:33:38.307662 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-94309839-4fc2-4d58-b9c4-63fbd5071971 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:38.308920 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-94309839-4fc2-4d58-b9c4-63fbd5071971 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:38.315561 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-94309839-4fc2-4d58-b9c4-63fbd5071971 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:38.316007 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-94309839-4fc2-4d58-b9c4-63fbd5071971 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:38.316762 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-94309839-4fc2-4d58-b9c4-63fbd5071971 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:38.317218 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-94309839-4fc2-4d58-b9c4-63fbd5071971 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:38.447708 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-94309839-4fc2-4d58-b9c4-63fbd5071971 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:38.456614 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-94309839-4fc2-4d58-b9c4-63fbd5071971 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:38.458242 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-94309839-4fc2-4d58-b9c4-63fbd5071971 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:38.459399 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-94309839-4fc2-4d58-b9c4-63fbd5071971 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1722 microversion: 2.20 time: 0.155896 Jul 28 05:33:38.459946 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 145/284] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:33:38 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:33:38.955331 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-0e774d6e-7a7f-42d1-be80-792405636659 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:38.955942 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-0e774d6e-7a7f-42d1-be80-792405636659 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:38.962342 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-0e774d6e-7a7f-42d1-be80-792405636659 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:38.962792 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-0e774d6e-7a7f-42d1-be80-792405636659 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:38.964716 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-0e774d6e-7a7f-42d1-be80-792405636659 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:38.964716 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-0e774d6e-7a7f-42d1-be80-792405636659 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:39.092552 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-0e774d6e-7a7f-42d1-be80-792405636659 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:39.099988 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-0e774d6e-7a7f-42d1-be80-792405636659 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9" status: 200 len: 1372 microversion: 2.1 time: 0.148441 Jul 28 05:33:39.100576 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 140/285] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:33:38 2022] GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 => generated 1372 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:33:39.483066 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-aec20ec9-6644-402b-a52e-7053223222d2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:39.483711 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-aec20ec9-6644-402b-a52e-7053223222d2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:39.537750 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-aec20ec9-6644-402b-a52e-7053223222d2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:39.537750 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-aec20ec9-6644-402b-a52e-7053223222d2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:39.537750 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-aec20ec9-6644-402b-a52e-7053223222d2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:39.537750 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-aec20ec9-6644-402b-a52e-7053223222d2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:39.538081 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:33:39.625823 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-aec20ec9-6644-402b-a52e-7053223222d2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:39.633419 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-aec20ec9-6644-402b-a52e-7053223222d2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:39.634949 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-aec20ec9-6644-402b-a52e-7053223222d2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:39.636629 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-aec20ec9-6644-402b-a52e-7053223222d2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1722 microversion: 2.20 time: 0.157552 Jul 28 05:33:39.637276 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 146/286] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:33:39 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:33:40.122242 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-495ae897-8602-4694-9c33-991606689730 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:40.123028 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-495ae897-8602-4694-9c33-991606689730 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:40.129790 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-495ae897-8602-4694-9c33-991606689730 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:40.130240 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-495ae897-8602-4694-9c33-991606689730 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:40.131010 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-495ae897-8602-4694-9c33-991606689730 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:40.131447 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-495ae897-8602-4694-9c33-991606689730 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:40.267945 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-495ae897-8602-4694-9c33-991606689730 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:40.275852 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-495ae897-8602-4694-9c33-991606689730 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9" status: 200 len: 1372 microversion: 2.1 time: 0.158432 Jul 28 05:33:40.276505 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 141/287] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:33:40 2022] GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:33:40.660177 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-34a0ebec-d4dc-4c56-a905-c44bdbff5007 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:40.660908 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-34a0ebec-d4dc-4c56-a905-c44bdbff5007 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:40.668852 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-34a0ebec-d4dc-4c56-a905-c44bdbff5007 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:40.669380 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-34a0ebec-d4dc-4c56-a905-c44bdbff5007 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:40.670270 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-34a0ebec-d4dc-4c56-a905-c44bdbff5007 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:40.670762 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-34a0ebec-d4dc-4c56-a905-c44bdbff5007 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:40.806167 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-34a0ebec-d4dc-4c56-a905-c44bdbff5007 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:40.814538 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-34a0ebec-d4dc-4c56-a905-c44bdbff5007 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:40.815966 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-34a0ebec-d4dc-4c56-a905-c44bdbff5007 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:40.817129 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-34a0ebec-d4dc-4c56-a905-c44bdbff5007 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1722 microversion: 2.20 time: 0.160860 Jul 28 05:33:40.817709 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 147/288] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:33:40 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:33:41.296360 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-d1cb3d39-6d6c-4e6b-bfed-fdd10cff6343 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:41.296969 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-d1cb3d39-6d6c-4e6b-bfed-fdd10cff6343 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:41.303787 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-d1cb3d39-6d6c-4e6b-bfed-fdd10cff6343 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:41.304234 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-d1cb3d39-6d6c-4e6b-bfed-fdd10cff6343 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:41.304998 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-d1cb3d39-6d6c-4e6b-bfed-fdd10cff6343 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:41.305436 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-d1cb3d39-6d6c-4e6b-bfed-fdd10cff6343 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:41.441663 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-d1cb3d39-6d6c-4e6b-bfed-fdd10cff6343 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:41.450035 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-d1cb3d39-6d6c-4e6b-bfed-fdd10cff6343 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9" status: 200 len: 1372 microversion: 2.1 time: 0.157637 Jul 28 05:33:41.450602 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 142/289] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:33:41 2022] GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:33:41.840809 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-99a930ea-4719-4d3e-9ff1-cbc32c6136e7 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:41.842182 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-99a930ea-4719-4d3e-9ff1-cbc32c6136e7 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:41.849079 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-99a930ea-4719-4d3e-9ff1-cbc32c6136e7 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:41.849556 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-99a930ea-4719-4d3e-9ff1-cbc32c6136e7 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:41.850341 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-99a930ea-4719-4d3e-9ff1-cbc32c6136e7 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:41.850753 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-99a930ea-4719-4d3e-9ff1-cbc32c6136e7 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:41.986906 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-99a930ea-4719-4d3e-9ff1-cbc32c6136e7 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:41.995035 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-99a930ea-4719-4d3e-9ff1-cbc32c6136e7 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:41.996560 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-99a930ea-4719-4d3e-9ff1-cbc32c6136e7 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:42.000216 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-99a930ea-4719-4d3e-9ff1-cbc32c6136e7 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1722 microversion: 2.20 time: 0.161372 Jul 28 05:33:42.000216 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 148/290] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:33:41 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 05:33:42.085342 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [req-e8c31e5f-5a1a-4286-9c4d-8ec32693b9ad req-a9774190-c53b-4077-86a3-bc58d17e08f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9", "name": "network-vif-plugged", "status": "completed", "tag": "1507aad5-e944-47e5-a8d9-716f5bde1fff"}]} {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:33:42.096133 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [req-e8c31e5f-5a1a-4286-9c4d-8ec32693b9ad req-a9774190-c53b-4077-86a3-bc58d17e08f1 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:42.096579 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [req-e8c31e5f-5a1a-4286-9c4d-8ec32693b9ad req-a9774190-c53b-4077-86a3-bc58d17e08f1 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:42.112000 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.compute.server_external_events [req-e8c31e5f-5a1a-4286-9c4d-8ec32693b9ad req-a9774190-c53b-4077-86a3-bc58d17e08f1 service nova] Creating event network-vif-plugged:1507aad5-e944-47e5-a8d9-716f5bde1fff for instance 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 on hv-cinder-79987 Jul 28 05:33:42.119366 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [req-e8c31e5f-5a1a-4286-9c4d-8ec32693b9ad req-a9774190-c53b-4077-86a3-bc58d17e08f1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038550 Jul 28 05:33:42.120056 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 143/291] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:33:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:33:42.286070 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-95f684ae-e640-4eae-af43-809e814e65ee tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:33:42.292291 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-95f684ae-e640-4eae-af43-809e814e65ee tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:42.293234 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-95f684ae-e640-4eae-af43-809e814e65ee tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:42.352160 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-95f684ae-e640-4eae-af43-809e814e65ee tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Going to try to stop instance {{(pid=124482) force_stop /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 05:33:42.472323 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-d261e0ab-5230-4ff9-9c42-cd16223e13c0 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:42.474123 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-d261e0ab-5230-4ff9-9c42-cd16223e13c0 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:42.485836 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-d261e0ab-5230-4ff9-9c42-cd16223e13c0 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:42.486330 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-d261e0ab-5230-4ff9-9c42-cd16223e13c0 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:42.487138 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-d261e0ab-5230-4ff9-9c42-cd16223e13c0 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:42.487588 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-d261e0ab-5230-4ff9-9c42-cd16223e13c0 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:42.554648 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-95f684ae-e640-4eae-af43-809e814e65ee tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "POST /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268/action" status: 202 len: 0 microversion: 2.1 time: 0.272208 Jul 28 05:33:42.555256 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 149/292] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Jul 28 05:33:42 2022] POST /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 05:33:42.563897 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-480ac86a-085d-499f-9a3e-62984d74187e tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:42.564733 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-480ac86a-085d-499f-9a3e-62984d74187e tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:42.571078 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-480ac86a-085d-499f-9a3e-62984d74187e tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:42.571697 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-480ac86a-085d-499f-9a3e-62984d74187e tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:42.572521 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-480ac86a-085d-499f-9a3e-62984d74187e tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:42.572949 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-480ac86a-085d-499f-9a3e-62984d74187e tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:42.627888 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-d261e0ab-5230-4ff9-9c42-cd16223e13c0 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:42.635220 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-d261e0ab-5230-4ff9-9c42-cd16223e13c0 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9" status: 200 len: 1372 microversion: 2.1 time: 0.167586 Jul 28 05:33:42.635791 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 144/293] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:33:42 2022] GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 => generated 1372 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:33:42.715895 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-480ac86a-085d-499f-9a3e-62984d74187e tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:42.723884 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-480ac86a-085d-499f-9a3e-62984d74187e tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 200 len: 1724 microversion: 2.1 time: 0.164268 Jul 28 05:33:42.726190 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 150/294] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:33:42 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:33:43.021207 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-0eac7ca1-17d1-4dc4-b8f3-76842d24ef2e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:43.025054 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-0eac7ca1-17d1-4dc4-b8f3-76842d24ef2e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:43.028661 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-0eac7ca1-17d1-4dc4-b8f3-76842d24ef2e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:43.029193 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-0eac7ca1-17d1-4dc4-b8f3-76842d24ef2e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:43.029993 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-0eac7ca1-17d1-4dc4-b8f3-76842d24ef2e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:43.030434 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-0eac7ca1-17d1-4dc4-b8f3-76842d24ef2e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:43.158330 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-0eac7ca1-17d1-4dc4-b8f3-76842d24ef2e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:43.166076 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-0eac7ca1-17d1-4dc4-b8f3-76842d24ef2e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:43.167759 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-0eac7ca1-17d1-4dc4-b8f3-76842d24ef2e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:43.168907 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-0eac7ca1-17d1-4dc4-b8f3-76842d24ef2e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1722 microversion: 2.20 time: 0.151726 Jul 28 05:33:43.169461 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 145/295] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:33:43 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:33:43.655838 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-3a6815af-55b7-4e8f-9e2c-8bac65aa509e tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:43.656445 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-3a6815af-55b7-4e8f-9e2c-8bac65aa509e tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:43.663309 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3a6815af-55b7-4e8f-9e2c-8bac65aa509e tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:43.663759 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3a6815af-55b7-4e8f-9e2c-8bac65aa509e tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:43.664526 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3a6815af-55b7-4e8f-9e2c-8bac65aa509e tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:43.664969 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3a6815af-55b7-4e8f-9e2c-8bac65aa509e tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:43.746839 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-6e56dcc6-78a5-4114-8b55-b2fc8b9df7da tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:43.747537 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-6e56dcc6-78a5-4114-8b55-b2fc8b9df7da tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:43.754084 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-6e56dcc6-78a5-4114-8b55-b2fc8b9df7da tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:43.754522 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-6e56dcc6-78a5-4114-8b55-b2fc8b9df7da tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:43.755281 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-6e56dcc6-78a5-4114-8b55-b2fc8b9df7da tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:43.755709 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-6e56dcc6-78a5-4114-8b55-b2fc8b9df7da tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:43.816186 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-3a6815af-55b7-4e8f-9e2c-8bac65aa509e tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:43.823831 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-3a6815af-55b7-4e8f-9e2c-8bac65aa509e tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9" status: 200 len: 1372 microversion: 2.1 time: 0.171664 Jul 28 05:33:43.824618 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 151/296] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:33:43 2022] GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 => generated 1372 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:33:43.900911 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-6e56dcc6-78a5-4114-8b55-b2fc8b9df7da tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:43.909487 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-6e56dcc6-78a5-4114-8b55-b2fc8b9df7da tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 200 len: 1724 microversion: 2.1 time: 0.167403 Jul 28 05:33:43.910048 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 146/297] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:33:43 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:33:44.191663 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-458c87ae-8da8-48d0-8459-72aced2c8c55 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:44.192192 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-458c87ae-8da8-48d0-8459-72aced2c8c55 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:44.200633 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-458c87ae-8da8-48d0-8459-72aced2c8c55 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:44.201079 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-458c87ae-8da8-48d0-8459-72aced2c8c55 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:44.201870 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-458c87ae-8da8-48d0-8459-72aced2c8c55 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:44.202336 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-458c87ae-8da8-48d0-8459-72aced2c8c55 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:44.332339 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-458c87ae-8da8-48d0-8459-72aced2c8c55 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:44.340852 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-458c87ae-8da8-48d0-8459-72aced2c8c55 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:44.342389 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-458c87ae-8da8-48d0-8459-72aced2c8c55 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:44.343607 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-458c87ae-8da8-48d0-8459-72aced2c8c55 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1722 microversion: 2.20 time: 0.155890 Jul 28 05:33:44.344156 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 152/298] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:33:44 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:33:44.843972 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-2f2e359f-3db4-4c00-aef8-1cee269e3ba1 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:44.844588 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-2f2e359f-3db4-4c00-aef8-1cee269e3ba1 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:44.851251 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-2f2e359f-3db4-4c00-aef8-1cee269e3ba1 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:44.851687 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-2f2e359f-3db4-4c00-aef8-1cee269e3ba1 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:44.852452 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-2f2e359f-3db4-4c00-aef8-1cee269e3ba1 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:44.852892 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-2f2e359f-3db4-4c00-aef8-1cee269e3ba1 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:44.930552 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-c0316cce-bdc9-41b6-bd1c-97c6f5f35b34 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:44.931158 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-c0316cce-bdc9-41b6-bd1c-97c6f5f35b34 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:44.938517 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c0316cce-bdc9-41b6-bd1c-97c6f5f35b34 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:44.938957 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c0316cce-bdc9-41b6-bd1c-97c6f5f35b34 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:44.939715 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c0316cce-bdc9-41b6-bd1c-97c6f5f35b34 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:44.940140 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c0316cce-bdc9-41b6-bd1c-97c6f5f35b34 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:44.994679 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-2f2e359f-3db4-4c00-aef8-1cee269e3ba1 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:45.002765 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-2f2e359f-3db4-4c00-aef8-1cee269e3ba1 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9" status: 200 len: 1372 microversion: 2.1 time: 0.162591 Jul 28 05:33:45.004615 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 147/299] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:33:44 2022] GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 => generated 1372 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:33:45.078630 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-c0316cce-bdc9-41b6-bd1c-97c6f5f35b34 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:45.086670 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-c0316cce-bdc9-41b6-bd1c-97c6f5f35b34 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 200 len: 1724 microversion: 2.1 time: 0.159935 Jul 28 05:33:45.087237 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 153/300] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:33:44 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:33:45.365603 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-b3747863-0a42-4108-957f-c893bdbf6c57 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:45.366206 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-b3747863-0a42-4108-957f-c893bdbf6c57 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:45.372780 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-b3747863-0a42-4108-957f-c893bdbf6c57 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:45.373224 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-b3747863-0a42-4108-957f-c893bdbf6c57 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:45.374001 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-b3747863-0a42-4108-957f-c893bdbf6c57 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:45.374456 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-b3747863-0a42-4108-957f-c893bdbf6c57 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:45.506920 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-b3747863-0a42-4108-957f-c893bdbf6c57 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:45.514774 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-b3747863-0a42-4108-957f-c893bdbf6c57 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:45.516281 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-b3747863-0a42-4108-957f-c893bdbf6c57 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:45.517437 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-b3747863-0a42-4108-957f-c893bdbf6c57 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1722 microversion: 2.20 time: 0.155647 Jul 28 05:33:45.518019 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 148/301] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:33:45 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:33:46.024069 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-33655dc3-9fc7-4439-bf39-96c2b05b3feb tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:46.024679 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-33655dc3-9fc7-4439-bf39-96c2b05b3feb tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:46.032096 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-33655dc3-9fc7-4439-bf39-96c2b05b3feb tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:46.032550 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-33655dc3-9fc7-4439-bf39-96c2b05b3feb tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:46.033376 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-33655dc3-9fc7-4439-bf39-96c2b05b3feb tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:46.033842 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-33655dc3-9fc7-4439-bf39-96c2b05b3feb tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:46.112054 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-8441a0d1-560d-4766-b96a-0652fb5541f3 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:46.112664 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-8441a0d1-560d-4766-b96a-0652fb5541f3 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:46.119142 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-8441a0d1-560d-4766-b96a-0652fb5541f3 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:46.119583 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-8441a0d1-560d-4766-b96a-0652fb5541f3 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:46.120406 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-8441a0d1-560d-4766-b96a-0652fb5541f3 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:46.120843 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-8441a0d1-560d-4766-b96a-0652fb5541f3 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:46.171118 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-33655dc3-9fc7-4439-bf39-96c2b05b3feb tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:46.178470 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-33655dc3-9fc7-4439-bf39-96c2b05b3feb tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9" status: 200 len: 1372 microversion: 2.1 time: 0.158570 Jul 28 05:33:46.179035 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 154/302] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:33:46 2022] GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:33:46.254358 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-8441a0d1-560d-4766-b96a-0652fb5541f3 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:46.262991 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-8441a0d1-560d-4766-b96a-0652fb5541f3 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 200 len: 1724 microversion: 2.1 time: 0.154699 Jul 28 05:33:46.263567 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 149/303] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:33:46 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:33:46.540337 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-d8ec53f7-e287-4123-bc8f-34c817b6b08c tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:46.540943 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-d8ec53f7-e287-4123-bc8f-34c817b6b08c tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:46.546952 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d8ec53f7-e287-4123-bc8f-34c817b6b08c tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:46.547401 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d8ec53f7-e287-4123-bc8f-34c817b6b08c tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:46.548156 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d8ec53f7-e287-4123-bc8f-34c817b6b08c tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:46.548595 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d8ec53f7-e287-4123-bc8f-34c817b6b08c tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:46.675866 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-d8ec53f7-e287-4123-bc8f-34c817b6b08c tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:46.684252 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-d8ec53f7-e287-4123-bc8f-34c817b6b08c tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:46.685825 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-d8ec53f7-e287-4123-bc8f-34c817b6b08c tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:46.686998 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-d8ec53f7-e287-4123-bc8f-34c817b6b08c tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1722 microversion: 2.20 time: 0.150546 Jul 28 05:33:46.687553 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 155/304] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:33:46 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:33:47.200258 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-db59faf5-dc52-4da8-9a8a-ca9fc7efd858 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:47.200812 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-db59faf5-dc52-4da8-9a8a-ca9fc7efd858 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:47.207750 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-db59faf5-dc52-4da8-9a8a-ca9fc7efd858 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:47.208200 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-db59faf5-dc52-4da8-9a8a-ca9fc7efd858 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:47.208961 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-db59faf5-dc52-4da8-9a8a-ca9fc7efd858 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:47.209507 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-db59faf5-dc52-4da8-9a8a-ca9fc7efd858 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:47.284327 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-8bb3a59c-190a-4e71-8f3b-98ffe1e62f4d tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:47.285688 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-8bb3a59c-190a-4e71-8f3b-98ffe1e62f4d tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:47.293311 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8bb3a59c-190a-4e71-8f3b-98ffe1e62f4d tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:47.293977 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8bb3a59c-190a-4e71-8f3b-98ffe1e62f4d tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:47.295007 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8bb3a59c-190a-4e71-8f3b-98ffe1e62f4d tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:47.295638 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8bb3a59c-190a-4e71-8f3b-98ffe1e62f4d tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:47.375686 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-db59faf5-dc52-4da8-9a8a-ca9fc7efd858 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:47.383431 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-db59faf5-dc52-4da8-9a8a-ca9fc7efd858 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9" status: 200 len: 1372 microversion: 2.1 time: 0.187829 Jul 28 05:33:47.384000 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 150/305] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:33:47 2022] GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 => generated 1372 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:33:47.443973 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-8bb3a59c-190a-4e71-8f3b-98ffe1e62f4d tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:47.452174 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-8bb3a59c-190a-4e71-8f3b-98ffe1e62f4d tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 200 len: 1724 microversion: 2.1 time: 0.171870 Jul 28 05:33:47.452673 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 156/306] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:33:47 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:33:47.710588 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-b8538600-5369-4f3f-85d4-ee3a2e3e0cb3 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:47.711119 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-b8538600-5369-4f3f-85d4-ee3a2e3e0cb3 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:47.717775 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-b8538600-5369-4f3f-85d4-ee3a2e3e0cb3 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:47.718226 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-b8538600-5369-4f3f-85d4-ee3a2e3e0cb3 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:47.718981 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-b8538600-5369-4f3f-85d4-ee3a2e3e0cb3 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:47.719414 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-b8538600-5369-4f3f-85d4-ee3a2e3e0cb3 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:47.723486 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG dbcounter [-] [124483] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:33:47.845859 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-b8538600-5369-4f3f-85d4-ee3a2e3e0cb3 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:47.853650 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-b8538600-5369-4f3f-85d4-ee3a2e3e0cb3 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:47.855538 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-b8538600-5369-4f3f-85d4-ee3a2e3e0cb3 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:47.856703 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-b8538600-5369-4f3f-85d4-ee3a2e3e0cb3 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1722 microversion: 2.20 time: 0.150160 Jul 28 05:33:47.857268 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 151/307] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:33:47 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:33:48.404138 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-e83d3232-d27b-443b-8301-929075964a9a tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:48.404747 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-e83d3232-d27b-443b-8301-929075964a9a tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:48.411361 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e83d3232-d27b-443b-8301-929075964a9a tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:48.411837 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e83d3232-d27b-443b-8301-929075964a9a tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:48.412593 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e83d3232-d27b-443b-8301-929075964a9a tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:48.413030 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e83d3232-d27b-443b-8301-929075964a9a tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:48.473786 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-fb64a5bc-8740-45f6-824e-3429aae4478a tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:48.475149 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-fb64a5bc-8740-45f6-824e-3429aae4478a tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:48.482582 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-fb64a5bc-8740-45f6-824e-3429aae4478a tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:48.483249 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-fb64a5bc-8740-45f6-824e-3429aae4478a tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:48.484179 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-fb64a5bc-8740-45f6-824e-3429aae4478a tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:48.484895 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-fb64a5bc-8740-45f6-824e-3429aae4478a tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:48.599906 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-e83d3232-d27b-443b-8301-929075964a9a tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:48.608759 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-e83d3232-d27b-443b-8301-929075964a9a tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9" status: 200 len: 1565 microversion: 2.1 time: 0.208482 Jul 28 05:33:48.609344 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 157/308] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:33:48 2022] GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 => generated 1565 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:33:48.629847 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-5af9a6b7-349c-4d1f-81bf-77a8b9758fac tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:48.630497 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-5af9a6b7-349c-4d1f-81bf-77a8b9758fac tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:48.637309 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5af9a6b7-349c-4d1f-81bf-77a8b9758fac tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:48.637818 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5af9a6b7-349c-4d1f-81bf-77a8b9758fac tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:48.638586 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5af9a6b7-349c-4d1f-81bf-77a8b9758fac tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:48.639021 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5af9a6b7-349c-4d1f-81bf-77a8b9758fac tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:48.645256 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-fb64a5bc-8740-45f6-824e-3429aae4478a tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:48.654331 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-fb64a5bc-8740-45f6-824e-3429aae4478a tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 200 len: 1724 microversion: 2.1 time: 0.184461 Jul 28 05:33:48.654963 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 152/309] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:33:48 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:33:48.717976 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-5af9a6b7-349c-4d1f-81bf-77a8b9758fac tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092051 Jul 28 05:33:48.722247 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 158/310] 10.222.0.33 () {58 vars in 1275 bytes} [Thu Jul 28 05:33:48 2022] GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:33:48.879608 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-e303de60-b071-44c6-8b45-59b339b93867 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:48.880227 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-e303de60-b071-44c6-8b45-59b339b93867 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:48.886944 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-e303de60-b071-44c6-8b45-59b339b93867 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:48.887400 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-e303de60-b071-44c6-8b45-59b339b93867 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:48.888172 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-e303de60-b071-44c6-8b45-59b339b93867 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:48.888611 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-e303de60-b071-44c6-8b45-59b339b93867 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:49.131770 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-e303de60-b071-44c6-8b45-59b339b93867 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:49.140909 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-e303de60-b071-44c6-8b45-59b339b93867 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:49.142565 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-e303de60-b071-44c6-8b45-59b339b93867 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:49.143816 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-e303de60-b071-44c6-8b45-59b339b93867 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1722 microversion: 2.20 time: 0.268357 Jul 28 05:33:49.144377 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 153/311] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:33:48 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1722 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:33:49.677061 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-da178867-b9e2-41d6-9740-69fd1e4c895b tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:49.677724 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-da178867-b9e2-41d6-9740-69fd1e4c895b tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:49.685048 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-da178867-b9e2-41d6-9740-69fd1e4c895b tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:49.685524 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-da178867-b9e2-41d6-9740-69fd1e4c895b tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:49.686295 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-da178867-b9e2-41d6-9740-69fd1e4c895b tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:49.686916 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-da178867-b9e2-41d6-9740-69fd1e4c895b tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:49.869462 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [req-09b26da3-54ad-4ccc-9f54-d23db6c67d92 req-6399907a-b4e1-4f00-9b37-ba9b78fdfa14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9", "tag": "1507aad5-e944-47e5-a8d9-716f5bde1fff"}]} {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:33:49.884198 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [req-09b26da3-54ad-4ccc-9f54-d23db6c67d92 req-6399907a-b4e1-4f00-9b37-ba9b78fdfa14 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:49.884963 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [req-09b26da3-54ad-4ccc-9f54-d23db6c67d92 req-6399907a-b4e1-4f00-9b37-ba9b78fdfa14 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:49.890069 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-da178867-b9e2-41d6-9740-69fd1e4c895b tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:49.902436 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-da178867-b9e2-41d6-9740-69fd1e4c895b tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 200 len: 1724 microversion: 2.1 time: 0.227708 Jul 28 05:33:49.914255 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 159/312] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:33:49 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 1724 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:33:49.920145 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.compute.server_external_events [req-09b26da3-54ad-4ccc-9f54-d23db6c67d92 req-6399907a-b4e1-4f00-9b37-ba9b78fdfa14 service nova] Creating event network-changed:1507aad5-e944-47e5-a8d9-716f5bde1fff for instance 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 on hv-cinder-79987 Jul 28 05:33:49.925967 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [req-09b26da3-54ad-4ccc-9f54-d23db6c67d92 req-6399907a-b4e1-4f00-9b37-ba9b78fdfa14 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062909 Jul 28 05:33:49.927268 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 154/313] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:33:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:33:49.965926 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-8855eebe-92f6-4c4d-941d-fd40e86c66b6 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Action: 'create', calling method: .version_select at 0x7f25e048b550>, body: {"keypair": {"name": "tempest-keypair-514248105", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJcayxU5HwwL9VlUDrmbjeSl4rFBFO/+qJ7omEI8a3CSHvp5Mrre5mDlZP2IsWfeHlzFINg1Jj5eBYTfnv1LN4PX5qvR2eJWuc/Cs2oTjVAHCokRVdsX4Fs26oof4geY/g=="}} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:33:49.989134 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.quota [None req-8855eebe-92f6-4c4d-941d-fd40e86c66b6 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Getting quotas for project ba0b7f7639504a25a73c94335d62b98f. Resources: {'key_pairs'} {{(pid=124482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 05:33:49.993282 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.quota [None req-8855eebe-92f6-4c4d-941d-fd40e86c66b6 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Getting quotas for user 0002ebbc629b4dafb109dc94450fe1d8 and project ba0b7f7639504a25a73c94335d62b98f. Resources: {'key_pairs'} {{(pid=124482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 05:33:50.170084 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-d3b56978-4f6b-4c19-8224-c204972536cb tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:50.170298 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-d3b56978-4f6b-4c19-8224-c204972536cb tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:50.177542 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-d3b56978-4f6b-4c19-8224-c204972536cb tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:50.178385 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-d3b56978-4f6b-4c19-8224-c204972536cb tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:50.179245 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-d3b56978-4f6b-4c19-8224-c204972536cb tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:50.179891 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-d3b56978-4f6b-4c19-8224-c204972536cb tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:50.205040 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-8855eebe-92f6-4c4d-941d-fd40e86c66b6 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.243018 Jul 28 05:33:50.206638 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 160/314] 10.222.0.33 () {60 vars in 1159 bytes} [Thu Jul 28 05:33:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:33:50.499830 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-d3b56978-4f6b-4c19-8224-c204972536cb tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:50.516391 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-d3b56978-4f6b-4c19-8224-c204972536cb tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:50.518433 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-d3b56978-4f6b-4c19-8224-c204972536cb tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:50.519952 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-d3b56978-4f6b-4c19-8224-c204972536cb tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1743 microversion: 2.20 time: 0.355596 Jul 28 05:33:50.520499 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 155/315] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:33:50 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1743 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:33:50.924685 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-498b64d1-f713-46cd-98d1-08b91a4ee9b3 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:50.928273 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-498b64d1-f713-46cd-98d1-08b91a4ee9b3 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:50.935961 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-498b64d1-f713-46cd-98d1-08b91a4ee9b3 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:50.936481 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-498b64d1-f713-46cd-98d1-08b91a4ee9b3 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:50.946402 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-498b64d1-f713-46cd-98d1-08b91a4ee9b3 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:50.947106 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-498b64d1-f713-46cd-98d1-08b91a4ee9b3 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:51.099304 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-498b64d1-f713-46cd-98d1-08b91a4ee9b3 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:51.107729 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-498b64d1-f713-46cd-98d1-08b91a4ee9b3 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 200 len: 1724 microversion: 2.1 time: 0.188418 Jul 28 05:33:51.108303 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 161/316] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:33:50 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:33:51.547140 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-edabbc96-a0ce-40ea-8708-f0e3e0ca8450 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:51.547721 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-edabbc96-a0ce-40ea-8708-f0e3e0ca8450 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:51.554668 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-edabbc96-a0ce-40ea-8708-f0e3e0ca8450 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:51.555700 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-edabbc96-a0ce-40ea-8708-f0e3e0ca8450 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:51.556748 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-edabbc96-a0ce-40ea-8708-f0e3e0ca8450 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:51.557444 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-edabbc96-a0ce-40ea-8708-f0e3e0ca8450 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:51.710595 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-edabbc96-a0ce-40ea-8708-f0e3e0ca8450 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:51.720652 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-edabbc96-a0ce-40ea-8708-f0e3e0ca8450 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:51.722398 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-edabbc96-a0ce-40ea-8708-f0e3e0ca8450 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:51.727020 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-edabbc96-a0ce-40ea-8708-f0e3e0ca8450 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1743 microversion: 2.20 time: 0.180751 Jul 28 05:33:51.727020 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 156/317] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:33:51 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1743 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:33:52.129136 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-e1334d54-4f29-4948-87c3-6f58264e2b49 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:52.133823 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-e1334d54-4f29-4948-87c3-6f58264e2b49 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:52.136924 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e1334d54-4f29-4948-87c3-6f58264e2b49 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:52.137462 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e1334d54-4f29-4948-87c3-6f58264e2b49 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:52.138261 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e1334d54-4f29-4948-87c3-6f58264e2b49 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:52.138756 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e1334d54-4f29-4948-87c3-6f58264e2b49 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:52.305447 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-e1334d54-4f29-4948-87c3-6f58264e2b49 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:52.315107 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-e1334d54-4f29-4948-87c3-6f58264e2b49 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 200 len: 1724 microversion: 2.1 time: 0.189756 Jul 28 05:33:52.330436 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 162/318] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:33:52 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:33:52.578869 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-dbbed3ab-427f-4b71-aa92-44685ac9584a tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2028378347", "imageRef": "4f0ce061-6677-4c2a-9ee1-54a100f21462", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f094ee85-e5f7-4f76-b25b-19d66faa4449"}], "security_groups": [{"name": "tempest-securitygroup--685305993"}], "key_name": "tempest-keypair-514248105", "user_data": "}} {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:33:52.692193 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.network.neutron [None req-dbbed3ab-427f-4b71-aa92-44685ac9584a tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] validate_networks() for [('f094ee85-e5f7-4f76-b25b-19d66faa4449', None, None, None, None, None)] {{(pid=124483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 05:33:52.750261 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-2cf20aa9-813c-46ae-85f4-52cea15c94f4 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:52.751017 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-2cf20aa9-813c-46ae-85f4-52cea15c94f4 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:52.758519 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2cf20aa9-813c-46ae-85f4-52cea15c94f4 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:52.765827 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2cf20aa9-813c-46ae-85f4-52cea15c94f4 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:52.765827 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2cf20aa9-813c-46ae-85f4-52cea15c94f4 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:52.765827 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2cf20aa9-813c-46ae-85f4-52cea15c94f4 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:52.777066 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:33:52.996278 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-2cf20aa9-813c-46ae-85f4-52cea15c94f4 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:53.007889 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-2cf20aa9-813c-46ae-85f4-52cea15c94f4 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:53.011926 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-2cf20aa9-813c-46ae-85f4-52cea15c94f4 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:53.013889 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-2cf20aa9-813c-46ae-85f4-52cea15c94f4 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1738 microversion: 2.20 time: 0.269457 Jul 28 05:33:53.015008 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 163/319] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:33:52 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1738 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 05:33:53.176169 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.virt.hardware [None req-dbbed3ab-427f-4b71-aa92-44685ac9584a tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Flavor limits 0:0:0 {{(pid=124483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 05:33:53.176583 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.virt.hardware [None req-dbbed3ab-427f-4b71-aa92-44685ac9584a tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Image limits 0:0:0 {{(pid=124483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 05:33:53.177046 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.virt.hardware [None req-dbbed3ab-427f-4b71-aa92-44685ac9584a tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Flavor pref 0:0:0 {{(pid=124483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 05:33:53.177447 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.virt.hardware [None req-dbbed3ab-427f-4b71-aa92-44685ac9584a tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Image pref 0:0:0 {{(pid=124483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 05:33:53.177873 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.virt.hardware [None req-dbbed3ab-427f-4b71-aa92-44685ac9584a tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 05:33:53.187561 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-dbbed3ab-427f-4b71-aa92-44685ac9584a tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:53.188004 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-dbbed3ab-427f-4b71-aa92-44685ac9584a tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:53.188784 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-dbbed3ab-427f-4b71-aa92-44685ac9584a tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:53.189325 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-dbbed3ab-427f-4b71-aa92-44685ac9584a tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:53.206554 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.quota [None req-dbbed3ab-427f-4b71-aa92-44685ac9584a tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Getting quotas for project ba0b7f7639504a25a73c94335d62b98f. Resources: {'ram', 'instances', 'cores'} {{(pid=124483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 05:33:53.210608 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.quota [None req-dbbed3ab-427f-4b71-aa92-44685ac9584a tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Getting quotas for user 0002ebbc629b4dafb109dc94450fe1d8 and project ba0b7f7639504a25a73c94335d62b98f. Resources: {'ram', 'instances', 'cores'} {{(pid=124483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 05:33:53.222585 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-dbbed3ab-427f-4b71-aa92-44685ac9584a tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Going to run 1 instances... {{(pid=124483) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 05:33:53.225102 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-dbbed3ab-427f-4b71-aa92-44685ac9584a tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: d2380b3f-75da-4c71-9bf5-bc1b1cb0611b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f0ce061-6677-4c2a-9ee1-54a100f21462',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 05:33:53.340159 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-b50681b4-95d8-4cbd-b887-60d5ba7c10e6 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:53.341422 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-b50681b4-95d8-4cbd-b887-60d5ba7c10e6 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:53.349507 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b50681b4-95d8-4cbd-b887-60d5ba7c10e6 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:53.350130 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b50681b4-95d8-4cbd-b887-60d5ba7c10e6 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:53.351193 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b50681b4-95d8-4cbd-b887-60d5ba7c10e6 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:53.351557 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b50681b4-95d8-4cbd-b887-60d5ba7c10e6 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:53.385316 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-dbbed3ab-427f-4b71-aa92-44685ac9584a tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.812276 Jul 28 05:33:53.386588 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 157/320] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Jul 28 05:33:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 814 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 05:33:53.399060 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-379af2cd-010a-4986-871d-f5c6be59c13d tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:53.399981 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-379af2cd-010a-4986-871d-f5c6be59c13d tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: d2380b3f-75da-4c71-9bf5-bc1b1cb0611b] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:53.511235 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-379af2cd-010a-4986-871d-f5c6be59c13d tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:53.520760 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-379af2cd-010a-4986-871d-f5c6be59c13d tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/d2380b3f-75da-4c71-9bf5-bc1b1cb0611b" status: 200 len: 1241 microversion: 2.1 time: 0.126324 Jul 28 05:33:53.524635 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 158/321] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:33:53 2022] GET /compute/v2.1/servers/d2380b3f-75da-4c71-9bf5-bc1b1cb0611b => generated 1241 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:33:53.620862 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-b50681b4-95d8-4cbd-b887-60d5ba7c10e6 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:53.629679 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-b50681b4-95d8-4cbd-b887-60d5ba7c10e6 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 200 len: 1724 microversion: 2.1 time: 0.294888 Jul 28 05:33:53.648129 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 164/322] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:33:53 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 1724 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:33:54.038368 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-1990ee85-69e9-445c-a3e5-f89077d0a487 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:54.038993 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-1990ee85-69e9-445c-a3e5-f89077d0a487 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:54.050523 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-1990ee85-69e9-445c-a3e5-f89077d0a487 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:54.050975 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-1990ee85-69e9-445c-a3e5-f89077d0a487 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:54.058111 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-1990ee85-69e9-445c-a3e5-f89077d0a487 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:54.058111 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-1990ee85-69e9-445c-a3e5-f89077d0a487 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:54.197559 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-aaaf017c-1a04-4ff3-950e-bb94db09868c req-da56c2f6-7445-4270-895c-230f337f59fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57115a26-af82-499e-a831-4b4c40e60ac5", "name": "network-vif-plugged", "status": "completed", "tag": "968687ce-4c57-4729-84c6-548124c4123e"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:33:54.221795 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-aaaf017c-1a04-4ff3-950e-bb94db09868c req-da56c2f6-7445-4270-895c-230f337f59fc service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:54.225036 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-aaaf017c-1a04-4ff3-950e-bb94db09868c req-da56c2f6-7445-4270-895c-230f337f59fc service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:54.240206 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-aaaf017c-1a04-4ff3-950e-bb94db09868c req-da56c2f6-7445-4270-895c-230f337f59fc service nova] Creating event network-vif-plugged:968687ce-4c57-4729-84c6-548124c4123e for instance 57115a26-af82-499e-a831-4b4c40e60ac5 on hv-cinder-79987 Jul 28 05:33:54.246672 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-aaaf017c-1a04-4ff3-950e-bb94db09868c req-da56c2f6-7445-4270-895c-230f337f59fc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062755 Jul 28 05:33:54.247567 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 165/323] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:33:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 05:33:54.330821 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-1990ee85-69e9-445c-a3e5-f89077d0a487 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:54.346582 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-1990ee85-69e9-445c-a3e5-f89077d0a487 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:54.349037 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-1990ee85-69e9-445c-a3e5-f89077d0a487 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:54.350943 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-1990ee85-69e9-445c-a3e5-f89077d0a487 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1738 microversion: 2.20 time: 0.316288 Jul 28 05:33:54.368794 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 159/324] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:33:54 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1738 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:33:54.546459 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-89a09b68-9295-436e-91c5-1da9dea898a7 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:54.547990 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-89a09b68-9295-436e-91c5-1da9dea898a7 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: d2380b3f-75da-4c71-9bf5-bc1b1cb0611b] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:54.554843 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-89a09b68-9295-436e-91c5-1da9dea898a7 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:54.555647 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-89a09b68-9295-436e-91c5-1da9dea898a7 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:54.556640 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-89a09b68-9295-436e-91c5-1da9dea898a7 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:54.557480 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-89a09b68-9295-436e-91c5-1da9dea898a7 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:54.680696 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-15db8086-6596-4127-897d-a303ccc3e51e tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:54.683327 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-15db8086-6596-4127-897d-a303ccc3e51e tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:54.696478 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-15db8086-6596-4127-897d-a303ccc3e51e tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:54.714332 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-89a09b68-9295-436e-91c5-1da9dea898a7 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:54.715128 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-15db8086-6596-4127-897d-a303ccc3e51e tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:54.715128 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-15db8086-6596-4127-897d-a303ccc3e51e tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:54.715128 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-15db8086-6596-4127-897d-a303ccc3e51e tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:54.716172 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-89a09b68-9295-436e-91c5-1da9dea898a7 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/d2380b3f-75da-4c71-9bf5-bc1b1cb0611b" status: 200 len: 1245 microversion: 2.1 time: 0.175404 Jul 28 05:33:54.727157 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 166/325] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:33:54 2022] GET /compute/v2.1/servers/d2380b3f-75da-4c71-9bf5-bc1b1cb0611b => generated 1245 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:33:54.904880 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-15db8086-6596-4127-897d-a303ccc3e51e tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:54.915775 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-15db8086-6596-4127-897d-a303ccc3e51e tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 200 len: 1724 microversion: 2.1 time: 0.266596 Jul 28 05:33:54.917287 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 160/326] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:33:54 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 1724 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:33:55.376089 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-67e05ffd-05aa-4203-8f14-fbbce693034c tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:55.376713 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-67e05ffd-05aa-4203-8f14-fbbce693034c tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:55.383095 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-67e05ffd-05aa-4203-8f14-fbbce693034c tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:55.383776 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-67e05ffd-05aa-4203-8f14-fbbce693034c tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:55.384546 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-67e05ffd-05aa-4203-8f14-fbbce693034c tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:55.385734 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-67e05ffd-05aa-4203-8f14-fbbce693034c tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:55.544375 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-67e05ffd-05aa-4203-8f14-fbbce693034c tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:55.553748 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-67e05ffd-05aa-4203-8f14-fbbce693034c tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:55.556217 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-67e05ffd-05aa-4203-8f14-fbbce693034c tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:55.558217 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-67e05ffd-05aa-4203-8f14-fbbce693034c tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1738 microversion: 2.20 time: 0.186287 Jul 28 05:33:55.559305 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 167/327] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:33:55 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1738 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:33:55.738953 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-721f7c17-b493-41c7-9f3f-004a08b24f60 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:55.739560 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-721f7c17-b493-41c7-9f3f-004a08b24f60 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: d2380b3f-75da-4c71-9bf5-bc1b1cb0611b] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:55.748635 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-721f7c17-b493-41c7-9f3f-004a08b24f60 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:55.749167 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-721f7c17-b493-41c7-9f3f-004a08b24f60 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:55.750050 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-721f7c17-b493-41c7-9f3f-004a08b24f60 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:55.750555 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-721f7c17-b493-41c7-9f3f-004a08b24f60 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:55.844200 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-721f7c17-b493-41c7-9f3f-004a08b24f60 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:55.852210 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-721f7c17-b493-41c7-9f3f-004a08b24f60 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/d2380b3f-75da-4c71-9bf5-bc1b1cb0611b" status: 200 len: 1293 microversion: 2.1 time: 0.117955 Jul 28 05:33:55.870547 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 161/328] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:33:55 2022] GET /compute/v2.1/servers/d2380b3f-75da-4c71-9bf5-bc1b1cb0611b => generated 1293 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:33:55.939099 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-0a058f8c-7f54-48f4-b11d-26e89c5b3b6d tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:55.939897 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-0a058f8c-7f54-48f4-b11d-26e89c5b3b6d tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:55.947159 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-0a058f8c-7f54-48f4-b11d-26e89c5b3b6d tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:55.948507 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-0a058f8c-7f54-48f4-b11d-26e89c5b3b6d tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:55.949292 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-0a058f8c-7f54-48f4-b11d-26e89c5b3b6d tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:55.949780 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-0a058f8c-7f54-48f4-b11d-26e89c5b3b6d tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:56.101887 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-0a058f8c-7f54-48f4-b11d-26e89c5b3b6d tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:56.111104 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-0a058f8c-7f54-48f4-b11d-26e89c5b3b6d tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 200 len: 1724 microversion: 2.1 time: 0.175885 Jul 28 05:33:56.126060 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 168/329] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:33:55 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:33:56.584292 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-65e38917-3498-477c-bb9c-37ee8205855f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:56.585034 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-65e38917-3498-477c-bb9c-37ee8205855f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:56.592274 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-65e38917-3498-477c-bb9c-37ee8205855f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:56.592832 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-65e38917-3498-477c-bb9c-37ee8205855f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:56.593968 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-65e38917-3498-477c-bb9c-37ee8205855f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:56.594579 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-65e38917-3498-477c-bb9c-37ee8205855f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:56.725569 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-65e38917-3498-477c-bb9c-37ee8205855f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:56.733354 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-65e38917-3498-477c-bb9c-37ee8205855f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:56.734874 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-65e38917-3498-477c-bb9c-37ee8205855f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:56.736018 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-65e38917-3498-477c-bb9c-37ee8205855f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1738 microversion: 2.20 time: 0.157046 Jul 28 05:33:56.736576 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 162/330] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:33:56 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:33:56.876932 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-d0c136b0-0771-4915-bbe2-77a51d64206f tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:56.877608 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-d0c136b0-0771-4915-bbe2-77a51d64206f tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: d2380b3f-75da-4c71-9bf5-bc1b1cb0611b] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:56.880120 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=1 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:33:56.884977 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d0c136b0-0771-4915-bbe2-77a51d64206f tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:56.886060 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d0c136b0-0771-4915-bbe2-77a51d64206f tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:56.886885 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d0c136b0-0771-4915-bbe2-77a51d64206f tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:56.887410 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d0c136b0-0771-4915-bbe2-77a51d64206f tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:56.952479 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-d0c136b0-0771-4915-bbe2-77a51d64206f tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:56.960836 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-d0c136b0-0771-4915-bbe2-77a51d64206f tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/d2380b3f-75da-4c71-9bf5-bc1b1cb0611b" status: 200 len: 1293 microversion: 2.1 time: 0.087876 Jul 28 05:33:56.962005 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 169/331] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:33:56 2022] GET /compute/v2.1/servers/d2380b3f-75da-4c71-9bf5-bc1b1cb0611b => generated 1293 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:33:57.134614 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-9b8e5231-39d2-44ec-81f7-adb05ce1b62f tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:57.135931 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-9b8e5231-39d2-44ec-81f7-adb05ce1b62f tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:57.146776 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-9b8e5231-39d2-44ec-81f7-adb05ce1b62f tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:57.147491 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-9b8e5231-39d2-44ec-81f7-adb05ce1b62f tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:57.148279 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-9b8e5231-39d2-44ec-81f7-adb05ce1b62f tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:57.148726 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-9b8e5231-39d2-44ec-81f7-adb05ce1b62f tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:57.459907 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-9b8e5231-39d2-44ec-81f7-adb05ce1b62f tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:57.487173 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-9b8e5231-39d2-44ec-81f7-adb05ce1b62f tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 200 len: 1724 microversion: 2.1 time: 0.356772 Jul 28 05:33:57.488015 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 163/332] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:33:57 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 1724 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:33:57.758324 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-d3bdd362-6304-42a5-9d90-322b221d866c tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:57.758928 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-d3bdd362-6304-42a5-9d90-322b221d866c tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:57.775186 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d3bdd362-6304-42a5-9d90-322b221d866c tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:57.776922 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d3bdd362-6304-42a5-9d90-322b221d866c tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:57.778108 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d3bdd362-6304-42a5-9d90-322b221d866c tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:57.780882 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d3bdd362-6304-42a5-9d90-322b221d866c tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:57.985852 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-d3bdd362-6304-42a5-9d90-322b221d866c tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:57.988979 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-aa3e1f21-2c8a-49c8-84a0-250b1cf9b365 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:57.993205 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-aa3e1f21-2c8a-49c8-84a0-250b1cf9b365 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: d2380b3f-75da-4c71-9bf5-bc1b1cb0611b] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:58.004257 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-aa3e1f21-2c8a-49c8-84a0-250b1cf9b365 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:58.004729 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-d3bdd362-6304-42a5-9d90-322b221d866c tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:58.007624 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-d3bdd362-6304-42a5-9d90-322b221d866c tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:58.008356 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-aa3e1f21-2c8a-49c8-84a0-250b1cf9b365 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:58.009435 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-aa3e1f21-2c8a-49c8-84a0-250b1cf9b365 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:58.011676 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-aa3e1f21-2c8a-49c8-84a0-250b1cf9b365 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:58.017271 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-d3bdd362-6304-42a5-9d90-322b221d866c tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1738 microversion: 2.20 time: 0.256821 Jul 28 05:33:58.035900 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 170/333] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:33:57 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1738 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:33:58.120899 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-aa3e1f21-2c8a-49c8-84a0-250b1cf9b365 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:58.129454 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-aa3e1f21-2c8a-49c8-84a0-250b1cf9b365 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/d2380b3f-75da-4c71-9bf5-bc1b1cb0611b" status: 200 len: 1299 microversion: 2.1 time: 0.148967 Jul 28 05:33:58.133644 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 164/334] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:33:57 2022] GET /compute/v2.1/servers/d2380b3f-75da-4c71-9bf5-bc1b1cb0611b => generated 1299 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:33:58.510945 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-a4d27916-efae-4742-8776-af270407f0f0 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:58.512229 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-a4d27916-efae-4742-8776-af270407f0f0 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:58.525218 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a4d27916-efae-4742-8776-af270407f0f0 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:58.527910 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a4d27916-efae-4742-8776-af270407f0f0 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:58.527910 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a4d27916-efae-4742-8776-af270407f0f0 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:58.527910 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a4d27916-efae-4742-8776-af270407f0f0 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:58.804648 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-a4d27916-efae-4742-8776-af270407f0f0 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:58.813032 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-a4d27916-efae-4742-8776-af270407f0f0 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 200 len: 1724 microversion: 2.1 time: 0.306850 Jul 28 05:33:58.829611 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 171/335] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:33:58 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 1724 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:33:59.043135 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-04489970-0a5f-4539-9119-86ba6292ea43 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:59.043745 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-04489970-0a5f-4539-9119-86ba6292ea43 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:59.052120 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-04489970-0a5f-4539-9119-86ba6292ea43 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:59.053059 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-04489970-0a5f-4539-9119-86ba6292ea43 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:59.054329 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-04489970-0a5f-4539-9119-86ba6292ea43 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:59.054887 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-04489970-0a5f-4539-9119-86ba6292ea43 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:59.157505 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-8cfce292-7491-4879-b35d-fe87fd79b76e tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:59.160035 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-8cfce292-7491-4879-b35d-fe87fd79b76e tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: d2380b3f-75da-4c71-9bf5-bc1b1cb0611b] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:59.171524 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8cfce292-7491-4879-b35d-fe87fd79b76e tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:59.174394 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8cfce292-7491-4879-b35d-fe87fd79b76e tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:59.176580 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8cfce292-7491-4879-b35d-fe87fd79b76e tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:59.188738 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8cfce292-7491-4879-b35d-fe87fd79b76e tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:59.389805 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-04489970-0a5f-4539-9119-86ba6292ea43 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:59.405163 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-04489970-0a5f-4539-9119-86ba6292ea43 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:59.407395 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-04489970-0a5f-4539-9119-86ba6292ea43 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:59.408842 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-04489970-0a5f-4539-9119-86ba6292ea43 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1738 microversion: 2.20 time: 0.370157 Jul 28 05:33:59.409768 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 165/336] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:33:59 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1738 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:33:59.489689 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-8cfce292-7491-4879-b35d-fe87fd79b76e tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:33:59.498016 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-8cfce292-7491-4879-b35d-fe87fd79b76e tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/d2380b3f-75da-4c71-9bf5-bc1b1cb0611b" status: 200 len: 1366 microversion: 2.1 time: 0.349295 Jul 28 05:33:59.499269 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 172/337] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:33:59 2022] GET /compute/v2.1/servers/d2380b3f-75da-4c71-9bf5-bc1b1cb0611b => generated 1366 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:33:59.714210 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [req-cc1441c7-77e4-4ba2-b83b-4b42fbae2a9b req-80db8ced-2db4-4954-bbec-770177d6eb91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2380b3f-75da-4c71-9bf5-bc1b1cb0611b", "tag": "cd6c58a9-a2f7-4847-b8ea-62033cb3f2f2"}]} {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:33:59.753761 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [req-cc1441c7-77e4-4ba2-b83b-4b42fbae2a9b req-80db8ced-2db4-4954-bbec-770177d6eb91 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:59.754289 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [req-cc1441c7-77e4-4ba2-b83b-4b42fbae2a9b req-80db8ced-2db4-4954-bbec-770177d6eb91 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:59.776507 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.compute.server_external_events [req-cc1441c7-77e4-4ba2-b83b-4b42fbae2a9b req-80db8ced-2db4-4954-bbec-770177d6eb91 service nova] Creating event network-changed:cd6c58a9-a2f7-4847-b8ea-62033cb3f2f2 for instance d2380b3f-75da-4c71-9bf5-bc1b1cb0611b on hv-cinder-79987 Jul 28 05:33:59.784538 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [req-cc1441c7-77e4-4ba2-b83b-4b42fbae2a9b req-80db8ced-2db4-4954-bbec-770177d6eb91 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074303 Jul 28 05:33:59.785532 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 166/338] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:33:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 05:33:59.836523 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-1012c565-3ba2-45f7-a8d1-1166344f1637 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:33:59.837350 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-1012c565-3ba2-45f7-a8d1-1166344f1637 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:33:59.846301 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1012c565-3ba2-45f7-a8d1-1166344f1637 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:59.846992 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1012c565-3ba2-45f7-a8d1-1166344f1637 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:33:59.847965 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1012c565-3ba2-45f7-a8d1-1166344f1637 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:33:59.848457 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1012c565-3ba2-45f7-a8d1-1166344f1637 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:00.000830 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell0:SELECT=4 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:34:00.079884 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-1012c565-3ba2-45f7-a8d1-1166344f1637 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:00.090178 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-1012c565-3ba2-45f7-a8d1-1166344f1637 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 200 len: 1724 microversion: 2.1 time: 0.257637 Jul 28 05:34:00.090944 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 173/339] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:33:59 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 1724 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:34:00.434497 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-fe669a0d-3fc5-43e2-94eb-db5377f98513 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:00.435385 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-fe669a0d-3fc5-43e2-94eb-db5377f98513 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:00.453302 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-fe669a0d-3fc5-43e2-94eb-db5377f98513 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:00.453814 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-fe669a0d-3fc5-43e2-94eb-db5377f98513 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:00.454724 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-fe669a0d-3fc5-43e2-94eb-db5377f98513 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:00.455267 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-fe669a0d-3fc5-43e2-94eb-db5377f98513 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:00.518815 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-b5aaa126-708c-489d-88f3-8b52b4f99601 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:00.519482 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-b5aaa126-708c-489d-88f3-8b52b4f99601 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: d2380b3f-75da-4c71-9bf5-bc1b1cb0611b] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:00.527511 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b5aaa126-708c-489d-88f3-8b52b4f99601 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:00.528056 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b5aaa126-708c-489d-88f3-8b52b4f99601 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:00.528835 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b5aaa126-708c-489d-88f3-8b52b4f99601 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:00.529280 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b5aaa126-708c-489d-88f3-8b52b4f99601 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:00.661085 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-fe669a0d-3fc5-43e2-94eb-db5377f98513 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:00.669390 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-fe669a0d-3fc5-43e2-94eb-db5377f98513 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:00.670945 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-fe669a0d-3fc5-43e2-94eb-db5377f98513 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:00.672129 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-fe669a0d-3fc5-43e2-94eb-db5377f98513 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1738 microversion: 2.20 time: 0.243452 Jul 28 05:34:00.672689 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 167/340] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:34:00 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1738 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:34:00.715515 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-b5aaa126-708c-489d-88f3-8b52b4f99601 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:00.728638 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-b5aaa126-708c-489d-88f3-8b52b4f99601 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/d2380b3f-75da-4c71-9bf5-bc1b1cb0611b" status: 200 len: 1366 microversion: 2.1 time: 0.213716 Jul 28 05:34:00.729686 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 174/341] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:34:00 2022] GET /compute/v2.1/servers/d2380b3f-75da-4c71-9bf5-bc1b1cb0611b => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:34:01.120815 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-765abdce-a5f6-46c5-af6d-9eee75f40d15 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:01.121424 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-765abdce-a5f6-46c5-af6d-9eee75f40d15 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:01.132298 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-765abdce-a5f6-46c5-af6d-9eee75f40d15 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:01.132955 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-765abdce-a5f6-46c5-af6d-9eee75f40d15 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:01.133954 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-765abdce-a5f6-46c5-af6d-9eee75f40d15 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:01.134388 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-765abdce-a5f6-46c5-af6d-9eee75f40d15 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:01.319805 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-765abdce-a5f6-46c5-af6d-9eee75f40d15 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:01.339632 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-765abdce-a5f6-46c5-af6d-9eee75f40d15 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 200 len: 1724 microversion: 2.1 time: 0.225235 Jul 28 05:34:01.343278 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 168/342] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:34:01 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 1724 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:34:01.695395 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-78e58456-8db0-4044-81d9-4c8841851326 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:01.696624 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-78e58456-8db0-4044-81d9-4c8841851326 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:01.708038 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-78e58456-8db0-4044-81d9-4c8841851326 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:01.708862 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-78e58456-8db0-4044-81d9-4c8841851326 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:01.709906 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-78e58456-8db0-4044-81d9-4c8841851326 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:01.710606 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-78e58456-8db0-4044-81d9-4c8841851326 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:01.750248 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-6749ca2a-4b1c-4742-9e52-afdede15b81a tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:01.750859 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-6749ca2a-4b1c-4742-9e52-afdede15b81a tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: d2380b3f-75da-4c71-9bf5-bc1b1cb0611b] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:01.759536 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-6749ca2a-4b1c-4742-9e52-afdede15b81a tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:01.763572 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-6749ca2a-4b1c-4742-9e52-afdede15b81a tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:01.764408 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-6749ca2a-4b1c-4742-9e52-afdede15b81a tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:01.764997 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-6749ca2a-4b1c-4742-9e52-afdede15b81a tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:02.296809 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-78e58456-8db0-4044-81d9-4c8841851326 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:02.309224 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-78e58456-8db0-4044-81d9-4c8841851326 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:02.317428 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-78e58456-8db0-4044-81d9-4c8841851326 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:02.333892 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-78e58456-8db0-4044-81d9-4c8841851326 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1738 microversion: 2.20 time: 0.627647 Jul 28 05:34:02.333892 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 175/343] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:34:01 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1738 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:34:02.366179 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-ba98ef6d-a763-41a1-8a17-2320b1b17113 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:02.370571 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-ba98ef6d-a763-41a1-8a17-2320b1b17113 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:02.376359 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ba98ef6d-a763-41a1-8a17-2320b1b17113 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:02.377061 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ba98ef6d-a763-41a1-8a17-2320b1b17113 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:02.379089 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ba98ef6d-a763-41a1-8a17-2320b1b17113 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:02.379731 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ba98ef6d-a763-41a1-8a17-2320b1b17113 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:02.395539 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-6749ca2a-4b1c-4742-9e52-afdede15b81a tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:02.405409 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-6749ca2a-4b1c-4742-9e52-afdede15b81a tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/d2380b3f-75da-4c71-9bf5-bc1b1cb0611b" status: 200 len: 1366 microversion: 2.1 time: 0.658968 Jul 28 05:34:02.424202 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 169/344] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:34:01 2022] GET /compute/v2.1/servers/d2380b3f-75da-4c71-9bf5-bc1b1cb0611b => generated 1366 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:34:02.657215 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-ba98ef6d-a763-41a1-8a17-2320b1b17113 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:02.665222 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-ba98ef6d-a763-41a1-8a17-2320b1b17113 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 200 len: 1724 microversion: 2.1 time: 0.304785 Jul 28 05:34:02.677816 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 176/345] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:34:02 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 1724 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:34:03.347874 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-6da37f64-50be-49e2-88e8-a5f2a93646f0 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:03.349106 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-6da37f64-50be-49e2-88e8-a5f2a93646f0 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:03.351541 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG dbcounter [-] [124483] Writing DB stats nova_cell0:SELECT=2 {{(pid=124483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:34:03.352354 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG dbcounter [-] [124483] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=124483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:34:03.357902 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-6da37f64-50be-49e2-88e8-a5f2a93646f0 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:03.358559 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-6da37f64-50be-49e2-88e8-a5f2a93646f0 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:03.359507 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-6da37f64-50be-49e2-88e8-a5f2a93646f0 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:03.359990 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-6da37f64-50be-49e2-88e8-a5f2a93646f0 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:03.431100 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-bf5574cf-c4c3-47dd-8f77-d4d7258382a2 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:03.432682 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-bf5574cf-c4c3-47dd-8f77-d4d7258382a2 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: d2380b3f-75da-4c71-9bf5-bc1b1cb0611b] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:03.446219 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-bf5574cf-c4c3-47dd-8f77-d4d7258382a2 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:03.447005 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-bf5574cf-c4c3-47dd-8f77-d4d7258382a2 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:03.451813 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-bf5574cf-c4c3-47dd-8f77-d4d7258382a2 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:03.452668 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-bf5574cf-c4c3-47dd-8f77-d4d7258382a2 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:03.516404 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG dbcounter [-] [124483] Writing DB stats nova_cell0:SELECT=8 {{(pid=124483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:34:03.539400 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-6da37f64-50be-49e2-88e8-a5f2a93646f0 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:03.543599 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG dbcounter [-] [124483] Writing DB stats nova_cell1:SELECT=100 {{(pid=124483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:34:03.549877 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-6da37f64-50be-49e2-88e8-a5f2a93646f0 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:03.551715 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-6da37f64-50be-49e2-88e8-a5f2a93646f0 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:03.552937 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-6da37f64-50be-49e2-88e8-a5f2a93646f0 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1738 microversion: 2.20 time: 0.209089 Jul 28 05:34:03.553957 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 170/346] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:34:03 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1738 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:34:03.633958 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-bf5574cf-c4c3-47dd-8f77-d4d7258382a2 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:03.642383 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-bf5574cf-c4c3-47dd-8f77-d4d7258382a2 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/d2380b3f-75da-4c71-9bf5-bc1b1cb0611b" status: 200 len: 1366 microversion: 2.1 time: 0.215085 Jul 28 05:34:03.642996 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 177/347] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:34:03 2022] GET /compute/v2.1/servers/d2380b3f-75da-4c71-9bf5-bc1b1cb0611b => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:34:03.688955 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-3c966ca8-04ae-4e74-8315-d2fc6f771253 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:03.689598 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-3c966ca8-04ae-4e74-8315-d2fc6f771253 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:03.696238 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-3c966ca8-04ae-4e74-8315-d2fc6f771253 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:03.696681 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-3c966ca8-04ae-4e74-8315-d2fc6f771253 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:03.698026 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-3c966ca8-04ae-4e74-8315-d2fc6f771253 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:03.698459 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-3c966ca8-04ae-4e74-8315-d2fc6f771253 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:03.854401 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-3c966ca8-04ae-4e74-8315-d2fc6f771253 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:03.863546 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-3c966ca8-04ae-4e74-8315-d2fc6f771253 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 200 len: 1724 microversion: 2.1 time: 0.178363 Jul 28 05:34:03.864147 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 171/348] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:34:03 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:34:04.577125 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-14f1ffbc-17c5-4ecf-891a-b1a9d62d1499 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:04.578102 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-14f1ffbc-17c5-4ecf-891a-b1a9d62d1499 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:04.587017 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-14f1ffbc-17c5-4ecf-891a-b1a9d62d1499 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:04.588445 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-14f1ffbc-17c5-4ecf-891a-b1a9d62d1499 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:04.589550 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-14f1ffbc-17c5-4ecf-891a-b1a9d62d1499 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:04.590216 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-14f1ffbc-17c5-4ecf-891a-b1a9d62d1499 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:04.664780 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-31baba4c-c9b3-4818-96d2-c3ff46a1ec57 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:04.665392 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-31baba4c-c9b3-4818-96d2-c3ff46a1ec57 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: d2380b3f-75da-4c71-9bf5-bc1b1cb0611b] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:04.682324 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-31baba4c-c9b3-4818-96d2-c3ff46a1ec57 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:04.683130 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-31baba4c-c9b3-4818-96d2-c3ff46a1ec57 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:04.684125 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-31baba4c-c9b3-4818-96d2-c3ff46a1ec57 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:04.684556 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-31baba4c-c9b3-4818-96d2-c3ff46a1ec57 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:04.821178 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-14f1ffbc-17c5-4ecf-891a-b1a9d62d1499 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:04.831871 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-14f1ffbc-17c5-4ecf-891a-b1a9d62d1499 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:04.835315 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-14f1ffbc-17c5-4ecf-891a-b1a9d62d1499 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:04.836777 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-14f1ffbc-17c5-4ecf-891a-b1a9d62d1499 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1738 microversion: 2.20 time: 0.264502 Jul 28 05:34:04.838386 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 178/349] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:34:04 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1738 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:34:04.869862 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-31baba4c-c9b3-4818-96d2-c3ff46a1ec57 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:04.877700 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-31baba4c-c9b3-4818-96d2-c3ff46a1ec57 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/d2380b3f-75da-4c71-9bf5-bc1b1cb0611b" status: 200 len: 1366 microversion: 2.1 time: 0.217242 Jul 28 05:34:04.885447 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 172/350] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:34:04 2022] GET /compute/v2.1/servers/d2380b3f-75da-4c71-9bf5-bc1b1cb0611b => generated 1366 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:34:04.889589 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-2c91a830-89b7-4e8b-9b6c-228e6bd7786a tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:04.890207 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-2c91a830-89b7-4e8b-9b6c-228e6bd7786a tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:04.896927 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2c91a830-89b7-4e8b-9b6c-228e6bd7786a tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:04.897449 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2c91a830-89b7-4e8b-9b6c-228e6bd7786a tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:04.898259 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2c91a830-89b7-4e8b-9b6c-228e6bd7786a tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:04.898701 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2c91a830-89b7-4e8b-9b6c-228e6bd7786a tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:05.038589 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-2c91a830-89b7-4e8b-9b6c-228e6bd7786a tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:05.046910 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-2c91a830-89b7-4e8b-9b6c-228e6bd7786a tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 200 len: 1724 microversion: 2.1 time: 0.164670 Jul 28 05:34:05.061127 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 179/351] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:34:04 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:34:05.860735 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-0ceff014-816a-4274-bc27-e5d485368bbc tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:05.861261 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-0ceff014-816a-4274-bc27-e5d485368bbc tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:05.867686 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-0ceff014-816a-4274-bc27-e5d485368bbc tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:05.868136 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-0ceff014-816a-4274-bc27-e5d485368bbc tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:05.868894 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-0ceff014-816a-4274-bc27-e5d485368bbc tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:05.870180 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-0ceff014-816a-4274-bc27-e5d485368bbc tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:05.900172 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-9d3d05f6-1c32-4707-bdc3-061efe0809f0 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:05.901020 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-9d3d05f6-1c32-4707-bdc3-061efe0809f0 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: d2380b3f-75da-4c71-9bf5-bc1b1cb0611b] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:05.907595 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9d3d05f6-1c32-4707-bdc3-061efe0809f0 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:05.908039 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9d3d05f6-1c32-4707-bdc3-061efe0809f0 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:05.908805 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9d3d05f6-1c32-4707-bdc3-061efe0809f0 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:05.909240 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9d3d05f6-1c32-4707-bdc3-061efe0809f0 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:06.052298 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-0ceff014-816a-4274-bc27-e5d485368bbc tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:06.060515 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-0ceff014-816a-4274-bc27-e5d485368bbc tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:06.063594 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-0ceff014-816a-4274-bc27-e5d485368bbc tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:06.064782 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-0ceff014-816a-4274-bc27-e5d485368bbc tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1738 microversion: 2.20 time: 0.207974 Jul 28 05:34:06.065350 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 173/352] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:34:05 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1738 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:34:06.069799 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-ee432ad7-25ef-42f5-ab01-d1ef16feabf3 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:06.070405 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-ee432ad7-25ef-42f5-ab01-d1ef16feabf3 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:06.076388 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-ee432ad7-25ef-42f5-ab01-d1ef16feabf3 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:06.076839 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-ee432ad7-25ef-42f5-ab01-d1ef16feabf3 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:06.077683 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-ee432ad7-25ef-42f5-ab01-d1ef16feabf3 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:06.078155 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-ee432ad7-25ef-42f5-ab01-d1ef16feabf3 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:06.085391 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-9d3d05f6-1c32-4707-bdc3-061efe0809f0 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:06.088262 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell1:SELECT=100 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:34:06.094133 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-9d3d05f6-1c32-4707-bdc3-061efe0809f0 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/d2380b3f-75da-4c71-9bf5-bc1b1cb0611b" status: 200 len: 1366 microversion: 2.1 time: 0.198008 Jul 28 05:34:06.094882 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 180/353] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:34:05 2022] GET /compute/v2.1/servers/d2380b3f-75da-4c71-9bf5-bc1b1cb0611b => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:34:06.208270 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-ee432ad7-25ef-42f5-ab01-d1ef16feabf3 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:06.217319 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-ee432ad7-25ef-42f5-ab01-d1ef16feabf3 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 200 len: 1724 microversion: 2.1 time: 0.150999 Jul 28 05:34:06.217925 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 174/354] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:34:06 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:34:07.088525 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-9d83a5bd-cdf7-4d04-9271-6cb031b0bb3f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:07.089117 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-9d83a5bd-cdf7-4d04-9271-6cb031b0bb3f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:07.095597 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9d83a5bd-cdf7-4d04-9271-6cb031b0bb3f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:07.098399 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9d83a5bd-cdf7-4d04-9271-6cb031b0bb3f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:07.098399 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9d83a5bd-cdf7-4d04-9271-6cb031b0bb3f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:07.098399 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9d83a5bd-cdf7-4d04-9271-6cb031b0bb3f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:07.115133 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-158c325f-067a-4083-9ba7-6bbd8f1eedef tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:07.116225 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-158c325f-067a-4083-9ba7-6bbd8f1eedef tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: d2380b3f-75da-4c71-9bf5-bc1b1cb0611b] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:07.122957 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-158c325f-067a-4083-9ba7-6bbd8f1eedef tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:07.123410 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-158c325f-067a-4083-9ba7-6bbd8f1eedef tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:07.124181 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-158c325f-067a-4083-9ba7-6bbd8f1eedef tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:07.124622 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-158c325f-067a-4083-9ba7-6bbd8f1eedef tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:07.309897 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-9d83a5bd-cdf7-4d04-9271-6cb031b0bb3f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:07.314787 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-158c325f-067a-4083-9ba7-6bbd8f1eedef tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:07.318850 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-9d83a5bd-cdf7-4d04-9271-6cb031b0bb3f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:07.320435 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-9d83a5bd-cdf7-4d04-9271-6cb031b0bb3f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:07.321670 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-9d83a5bd-cdf7-4d04-9271-6cb031b0bb3f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1738 microversion: 2.20 time: 0.237459 Jul 28 05:34:07.329645 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 181/355] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:34:07 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1738 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:34:07.329776 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-158c325f-067a-4083-9ba7-6bbd8f1eedef tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/d2380b3f-75da-4c71-9bf5-bc1b1cb0611b" status: 200 len: 1366 microversion: 2.1 time: 0.211329 Jul 28 05:34:07.329776 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 175/356] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:34:07 2022] GET /compute/v2.1/servers/d2380b3f-75da-4c71-9bf5-bc1b1cb0611b => generated 1366 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:34:07.329924 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-5a826100-3383-4c0f-a551-f091920d6d88 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:07.329924 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-5a826100-3383-4c0f-a551-f091920d6d88 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:07.333684 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5a826100-3383-4c0f-a551-f091920d6d88 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:07.334138 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5a826100-3383-4c0f-a551-f091920d6d88 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:07.334904 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5a826100-3383-4c0f-a551-f091920d6d88 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:07.335356 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5a826100-3383-4c0f-a551-f091920d6d88 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:07.466487 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-5a826100-3383-4c0f-a551-f091920d6d88 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:07.474605 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-5a826100-3383-4c0f-a551-f091920d6d88 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 200 len: 1724 microversion: 2.1 time: 0.151421 Jul 28 05:34:07.475170 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 182/357] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:34:07 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:34:08.343557 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-688b5a19-c955-4e16-aa7f-38a2034b8ed2 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:08.344297 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-688b5a19-c955-4e16-aa7f-38a2034b8ed2 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: d2380b3f-75da-4c71-9bf5-bc1b1cb0611b] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:08.344417 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-689465de-41b7-4af1-80df-762e17de3eff tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:08.345025 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-689465de-41b7-4af1-80df-762e17de3eff tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:08.351023 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-688b5a19-c955-4e16-aa7f-38a2034b8ed2 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:08.351349 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-689465de-41b7-4af1-80df-762e17de3eff tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:08.351468 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-688b5a19-c955-4e16-aa7f-38a2034b8ed2 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:08.351804 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-689465de-41b7-4af1-80df-762e17de3eff tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:08.352204 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-688b5a19-c955-4e16-aa7f-38a2034b8ed2 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:08.352556 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-689465de-41b7-4af1-80df-762e17de3eff tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:08.352659 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-688b5a19-c955-4e16-aa7f-38a2034b8ed2 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:08.352987 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-689465de-41b7-4af1-80df-762e17de3eff tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:08.549636 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-688b5a19-c955-4e16-aa7f-38a2034b8ed2 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:08.552673 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-689465de-41b7-4af1-80df-762e17de3eff tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:08.558252 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-688b5a19-c955-4e16-aa7f-38a2034b8ed2 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/d2380b3f-75da-4c71-9bf5-bc1b1cb0611b" status: 200 len: 1366 microversion: 2.1 time: 0.218736 Jul 28 05:34:08.558831 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 176/358] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:34:08 2022] GET /compute/v2.1/servers/d2380b3f-75da-4c71-9bf5-bc1b1cb0611b => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:34:08.563319 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-7ad8e06c-7d25-4125-9821-ac75aba5b523 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:08.563938 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-7ad8e06c-7d25-4125-9821-ac75aba5b523 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:08.569301 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-689465de-41b7-4af1-80df-762e17de3eff tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:08.569801 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-7ad8e06c-7d25-4125-9821-ac75aba5b523 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:08.570255 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-7ad8e06c-7d25-4125-9821-ac75aba5b523 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:08.571078 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-7ad8e06c-7d25-4125-9821-ac75aba5b523 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:08.571471 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-689465de-41b7-4af1-80df-762e17de3eff tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:08.571886 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-7ad8e06c-7d25-4125-9821-ac75aba5b523 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:08.573202 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-689465de-41b7-4af1-80df-762e17de3eff tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1738 microversion: 2.20 time: 0.232644 Jul 28 05:34:08.573907 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 183/359] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:34:08 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1738 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 05:34:08.705078 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-7ad8e06c-7d25-4125-9821-ac75aba5b523 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:08.713670 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-7ad8e06c-7d25-4125-9821-ac75aba5b523 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 200 len: 1724 microversion: 2.1 time: 0.153268 Jul 28 05:34:08.714304 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 177/360] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:34:08 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:34:09.578819 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-996471eb-59df-4989-9ca7-c05f832a4936 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:09.579426 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-996471eb-59df-4989-9ca7-c05f832a4936 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: d2380b3f-75da-4c71-9bf5-bc1b1cb0611b] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:09.585909 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-996471eb-59df-4989-9ca7-c05f832a4936 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:09.586361 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-996471eb-59df-4989-9ca7-c05f832a4936 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:09.587123 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-996471eb-59df-4989-9ca7-c05f832a4936 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:09.587560 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-996471eb-59df-4989-9ca7-c05f832a4936 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:09.601044 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-f4557fe5-378d-4160-9deb-32110b2ba38d tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:09.602034 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-f4557fe5-378d-4160-9deb-32110b2ba38d tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:09.611267 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-f4557fe5-378d-4160-9deb-32110b2ba38d tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:09.612452 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-f4557fe5-378d-4160-9deb-32110b2ba38d tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:09.613262 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-f4557fe5-378d-4160-9deb-32110b2ba38d tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:09.613735 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-f4557fe5-378d-4160-9deb-32110b2ba38d tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:09.798261 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-996471eb-59df-4989-9ca7-c05f832a4936 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:09.805818 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-996471eb-59df-4989-9ca7-c05f832a4936 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/d2380b3f-75da-4c71-9bf5-bc1b1cb0611b" status: 200 len: 1366 microversion: 2.1 time: 0.230759 Jul 28 05:34:09.806033 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-f4557fe5-378d-4160-9deb-32110b2ba38d tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:09.806403 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 184/361] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:34:09 2022] GET /compute/v2.1/servers/d2380b3f-75da-4c71-9bf5-bc1b1cb0611b => generated 1366 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:34:09.810997 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-8ac92936-a352-495c-879b-fef944125e9d tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:09.814730 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-8ac92936-a352-495c-879b-fef944125e9d tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:09.814844 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-f4557fe5-378d-4160-9deb-32110b2ba38d tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:09.816103 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-f4557fe5-378d-4160-9deb-32110b2ba38d tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:09.817271 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-f4557fe5-378d-4160-9deb-32110b2ba38d tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1738 microversion: 2.20 time: 0.221214 Jul 28 05:34:09.818032 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 178/362] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:34:09 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1738 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:34:09.818520 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8ac92936-a352-495c-879b-fef944125e9d tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:09.818974 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8ac92936-a352-495c-879b-fef944125e9d tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:09.819744 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8ac92936-a352-495c-879b-fef944125e9d tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:09.820186 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8ac92936-a352-495c-879b-fef944125e9d tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:09.951287 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-8ac92936-a352-495c-879b-fef944125e9d tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:09.959570 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-8ac92936-a352-495c-879b-fef944125e9d tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 200 len: 1724 microversion: 2.1 time: 0.152003 Jul 28 05:34:09.960150 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 185/363] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:34:09 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:34:10.827476 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-93d3b0e4-3164-4a18-af54-26b9246400ab tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:10.828095 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-93d3b0e4-3164-4a18-af54-26b9246400ab tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: d2380b3f-75da-4c71-9bf5-bc1b1cb0611b] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:10.834724 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-93d3b0e4-3164-4a18-af54-26b9246400ab tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:10.840122 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-0d6bc4c0-6475-475d-b23b-5c8bee5ce25e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:10.840736 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-0d6bc4c0-6475-475d-b23b-5c8bee5ce25e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:10.845438 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-93d3b0e4-3164-4a18-af54-26b9246400ab tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:10.846361 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-93d3b0e4-3164-4a18-af54-26b9246400ab tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:10.846819 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-93d3b0e4-3164-4a18-af54-26b9246400ab tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:10.851842 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-0d6bc4c0-6475-475d-b23b-5c8bee5ce25e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:10.852303 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-0d6bc4c0-6475-475d-b23b-5c8bee5ce25e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:10.853081 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-0d6bc4c0-6475-475d-b23b-5c8bee5ce25e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:10.853541 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-0d6bc4c0-6475-475d-b23b-5c8bee5ce25e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:11.050113 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-93d3b0e4-3164-4a18-af54-26b9246400ab tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:11.059986 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-93d3b0e4-3164-4a18-af54-26b9246400ab tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/d2380b3f-75da-4c71-9bf5-bc1b1cb0611b" status: 200 len: 1366 microversion: 2.1 time: 0.235632 Jul 28 05:34:11.059986 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 179/364] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:34:10 2022] GET /compute/v2.1/servers/d2380b3f-75da-4c71-9bf5-bc1b1cb0611b => generated 1366 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:34:11.063217 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-0d6bc4c0-6475-475d-b23b-5c8bee5ce25e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:11.064303 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-233366dd-1265-4880-8a63-e33e0424f7d6 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:11.065087 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-233366dd-1265-4880-8a63-e33e0424f7d6 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:11.071634 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-233366dd-1265-4880-8a63-e33e0424f7d6 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:11.072329 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-233366dd-1265-4880-8a63-e33e0424f7d6 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:11.073677 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-233366dd-1265-4880-8a63-e33e0424f7d6 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:11.074246 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-233366dd-1265-4880-8a63-e33e0424f7d6 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:11.081106 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-0d6bc4c0-6475-475d-b23b-5c8bee5ce25e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:11.081106 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-0d6bc4c0-6475-475d-b23b-5c8bee5ce25e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:11.081106 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-0d6bc4c0-6475-475d-b23b-5c8bee5ce25e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1720 microversion: 2.20 time: 0.242338 Jul 28 05:34:11.081398 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 186/365] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:34:10 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1720 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 05:34:11.216794 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-233366dd-1265-4880-8a63-e33e0424f7d6 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:11.224985 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-233366dd-1265-4880-8a63-e33e0424f7d6 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 200 len: 1701 microversion: 2.1 time: 0.164814 Jul 28 05:34:11.225507 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 180/366] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:34:11 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 1701 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:34:11.246208 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-b91f1f25-7ebb-472b-9f66-3003a226c85d tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:34:11.252239 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b91f1f25-7ebb-472b-9f66-3003a226c85d tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:11.252718 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b91f1f25-7ebb-472b-9f66-3003a226c85d tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:11.274733 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-b91f1f25-7ebb-472b-9f66-3003a226c85d tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Going to try to start instance {{(pid=124482) start /opt/stack/nova/nova/compute/api.py:2733}} Jul 28 05:34:11.381792 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-b91f1f25-7ebb-472b-9f66-3003a226c85d tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "POST /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268/action" status: 202 len: 0 microversion: 2.1 time: 0.139297 Jul 28 05:34:11.382393 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 187/367] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Jul 28 05:34:11 2022] POST /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 05:34:11.390403 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-fe5fbdbd-c36d-4591-96ff-1041d6fbd7c2 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:11.391014 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-fe5fbdbd-c36d-4591-96ff-1041d6fbd7c2 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:11.397370 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-fe5fbdbd-c36d-4591-96ff-1041d6fbd7c2 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:11.397850 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-fe5fbdbd-c36d-4591-96ff-1041d6fbd7c2 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:11.398935 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-fe5fbdbd-c36d-4591-96ff-1041d6fbd7c2 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:11.399377 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-fe5fbdbd-c36d-4591-96ff-1041d6fbd7c2 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:11.530325 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-fe5fbdbd-c36d-4591-96ff-1041d6fbd7c2 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:11.538288 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-fe5fbdbd-c36d-4591-96ff-1041d6fbd7c2 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 200 len: 1710 microversion: 2.1 time: 0.151688 Jul 28 05:34:11.538858 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 181/368] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:34:11 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 1710 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:34:12.080321 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-c5f9917e-e05b-4a2b-b779-c8772841a759 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:12.081023 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-c5f9917e-e05b-4a2b-b779-c8772841a759 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: d2380b3f-75da-4c71-9bf5-bc1b1cb0611b] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:12.087264 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c5f9917e-e05b-4a2b-b779-c8772841a759 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:12.087716 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c5f9917e-e05b-4a2b-b779-c8772841a759 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:12.088598 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c5f9917e-e05b-4a2b-b779-c8772841a759 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:12.089044 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c5f9917e-e05b-4a2b-b779-c8772841a759 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:12.102220 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-34353fdd-6a41-4be2-b667-028bf7e8b3ce tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:12.102863 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-34353fdd-6a41-4be2-b667-028bf7e8b3ce tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:12.109606 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-34353fdd-6a41-4be2-b667-028bf7e8b3ce tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:12.110063 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-34353fdd-6a41-4be2-b667-028bf7e8b3ce tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:12.110902 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-34353fdd-6a41-4be2-b667-028bf7e8b3ce tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:12.111343 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-34353fdd-6a41-4be2-b667-028bf7e8b3ce tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:12.286377 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-c5f9917e-e05b-4a2b-b779-c8772841a759 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:12.293253 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-34353fdd-6a41-4be2-b667-028bf7e8b3ce tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:12.294220 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-c5f9917e-e05b-4a2b-b779-c8772841a759 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/d2380b3f-75da-4c71-9bf5-bc1b1cb0611b" status: 200 len: 1366 microversion: 2.1 time: 0.218532 Jul 28 05:34:12.294840 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 188/369] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:34:12 2022] GET /compute/v2.1/servers/d2380b3f-75da-4c71-9bf5-bc1b1cb0611b => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:34:12.301138 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-34353fdd-6a41-4be2-b667-028bf7e8b3ce tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:12.302676 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-34353fdd-6a41-4be2-b667-028bf7e8b3ce tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:12.303830 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-34353fdd-6a41-4be2-b667-028bf7e8b3ce tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1720 microversion: 2.20 time: 0.205542 Jul 28 05:34:12.304378 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 182/370] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:34:12 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1720 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 05:34:12.561054 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-1495eb5d-86fe-467f-a98d-81b0d2363783 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:12.561703 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-1495eb5d-86fe-467f-a98d-81b0d2363783 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:12.567660 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1495eb5d-86fe-467f-a98d-81b0d2363783 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:12.568112 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1495eb5d-86fe-467f-a98d-81b0d2363783 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:12.569145 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1495eb5d-86fe-467f-a98d-81b0d2363783 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:12.569613 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1495eb5d-86fe-467f-a98d-81b0d2363783 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:12.696360 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-1495eb5d-86fe-467f-a98d-81b0d2363783 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:12.704374 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-1495eb5d-86fe-467f-a98d-81b0d2363783 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 200 len: 1710 microversion: 2.1 time: 0.148066 Jul 28 05:34:12.704955 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 189/371] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:34:12 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 1710 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:34:13.315861 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-6a071b72-e005-421c-b089-798dd3486cb8 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:13.316491 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-6a071b72-e005-421c-b089-798dd3486cb8 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: d2380b3f-75da-4c71-9bf5-bc1b1cb0611b] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:13.323465 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-6a071b72-e005-421c-b089-798dd3486cb8 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:13.323911 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-6a071b72-e005-421c-b089-798dd3486cb8 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:13.324669 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-6a071b72-e005-421c-b089-798dd3486cb8 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:13.325107 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-6a071b72-e005-421c-b089-798dd3486cb8 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:13.327363 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-1f5bc865-b6b1-4666-948c-319169846f35 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:13.327964 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-1f5bc865-b6b1-4666-948c-319169846f35 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:13.334227 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1f5bc865-b6b1-4666-948c-319169846f35 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:13.334669 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1f5bc865-b6b1-4666-948c-319169846f35 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:13.335424 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1f5bc865-b6b1-4666-948c-319169846f35 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:13.335851 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1f5bc865-b6b1-4666-948c-319169846f35 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:13.521530 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-6a071b72-e005-421c-b089-798dd3486cb8 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:13.524656 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-1f5bc865-b6b1-4666-948c-319169846f35 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:13.529184 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-6a071b72-e005-421c-b089-798dd3486cb8 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/d2380b3f-75da-4c71-9bf5-bc1b1cb0611b" status: 200 len: 1366 microversion: 2.1 time: 0.217270 Jul 28 05:34:13.529891 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 183/372] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:34:13 2022] GET /compute/v2.1/servers/d2380b3f-75da-4c71-9bf5-bc1b1cb0611b => generated 1366 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:34:13.533130 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-1f5bc865-b6b1-4666-948c-319169846f35 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:13.534810 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-1f5bc865-b6b1-4666-948c-319169846f35 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:13.535979 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-1f5bc865-b6b1-4666-948c-319169846f35 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1720 microversion: 2.20 time: 0.212556 Jul 28 05:34:13.537361 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 190/373] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:34:13 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1720 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 05:34:13.725840 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-9f19d6d6-bc9c-4bfa-902e-955c509f9e66 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:13.726456 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-9f19d6d6-bc9c-4bfa-902e-955c509f9e66 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:13.732960 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-9f19d6d6-bc9c-4bfa-902e-955c509f9e66 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:13.733414 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-9f19d6d6-bc9c-4bfa-902e-955c509f9e66 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:13.734209 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-9f19d6d6-bc9c-4bfa-902e-955c509f9e66 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:13.734651 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-9f19d6d6-bc9c-4bfa-902e-955c509f9e66 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:13.859761 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-9f19d6d6-bc9c-4bfa-902e-955c509f9e66 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:13.867666 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-9f19d6d6-bc9c-4bfa-902e-955c509f9e66 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 200 len: 1710 microversion: 2.1 time: 0.145664 Jul 28 05:34:13.868230 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 184/374] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:34:13 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 1710 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:34:14.092436 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-1113d6c0-2f7f-42d8-b456-a291c2dfb627 req-7a094251-161e-4507-a139-02c4f581e94d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57115a26-af82-499e-a831-4b4c40e60ac5", "name": "network-vif-unplugged", "status": "completed", "tag": "968687ce-4c57-4729-84c6-548124c4123e"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:34:14.101933 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-1113d6c0-2f7f-42d8-b456-a291c2dfb627 req-7a094251-161e-4507-a139-02c4f581e94d service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:14.102368 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-1113d6c0-2f7f-42d8-b456-a291c2dfb627 req-7a094251-161e-4507-a139-02c4f581e94d service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:14.113823 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-1113d6c0-2f7f-42d8-b456-a291c2dfb627 req-7a094251-161e-4507-a139-02c4f581e94d service nova] Creating event network-vif-unplugged:968687ce-4c57-4729-84c6-548124c4123e for instance 57115a26-af82-499e-a831-4b4c40e60ac5 on hv-cinder-79987 Jul 28 05:34:14.118543 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-1113d6c0-2f7f-42d8-b456-a291c2dfb627 req-7a094251-161e-4507-a139-02c4f581e94d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029960 Jul 28 05:34:14.119120 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 191/375] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:34:14.550106 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-da669ea2-78c5-46df-b604-107ef7625248 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:14.550716 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-da669ea2-78c5-46df-b604-107ef7625248 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: d2380b3f-75da-4c71-9bf5-bc1b1cb0611b] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:14.557898 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-da669ea2-78c5-46df-b604-107ef7625248 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:14.558382 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-da669ea2-78c5-46df-b604-107ef7625248 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:14.559179 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-da669ea2-78c5-46df-b604-107ef7625248 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:14.559669 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-da669ea2-78c5-46df-b604-107ef7625248 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:14.560397 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-78ce4fcf-790e-45de-a000-85513f92b00e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:14.561093 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-78ce4fcf-790e-45de-a000-85513f92b00e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:14.576221 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-78ce4fcf-790e-45de-a000-85513f92b00e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:14.576345 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-78ce4fcf-790e-45de-a000-85513f92b00e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:14.577108 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-78ce4fcf-790e-45de-a000-85513f92b00e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:14.577568 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-78ce4fcf-790e-45de-a000-85513f92b00e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:14.754572 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-da669ea2-78c5-46df-b604-107ef7625248 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:14.763027 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-da669ea2-78c5-46df-b604-107ef7625248 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/d2380b3f-75da-4c71-9bf5-bc1b1cb0611b" status: 200 len: 1366 microversion: 2.1 time: 0.216754 Jul 28 05:34:14.767350 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 185/376] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:34:14 2022] GET /compute/v2.1/servers/d2380b3f-75da-4c71-9bf5-bc1b1cb0611b => generated 1366 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:34:14.779257 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-78ce4fcf-790e-45de-a000-85513f92b00e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:14.787213 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-78ce4fcf-790e-45de-a000-85513f92b00e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:14.788718 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-78ce4fcf-790e-45de-a000-85513f92b00e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:14.789895 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-78ce4fcf-790e-45de-a000-85513f92b00e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1720 microversion: 2.20 time: 0.234308 Jul 28 05:34:14.790455 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 192/377] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:34:14 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1720 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 05:34:14.889784 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-822886e8-b8eb-4968-bd46-4852bc69e2eb tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:14.890317 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-822886e8-b8eb-4968-bd46-4852bc69e2eb tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:14.896452 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-822886e8-b8eb-4968-bd46-4852bc69e2eb tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:14.900270 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-822886e8-b8eb-4968-bd46-4852bc69e2eb tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:14.900270 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-822886e8-b8eb-4968-bd46-4852bc69e2eb tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:14.900270 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-822886e8-b8eb-4968-bd46-4852bc69e2eb tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:15.031648 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-822886e8-b8eb-4968-bd46-4852bc69e2eb tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:15.039515 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-822886e8-b8eb-4968-bd46-4852bc69e2eb tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 200 len: 1710 microversion: 2.1 time: 0.154211 Jul 28 05:34:15.040080 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 186/378] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:34:14 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 1710 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:34:15.787246 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-9ce8bf10-5d1b-47b2-beac-d0ddadf4131f tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:15.787246 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-9ce8bf10-5d1b-47b2-beac-d0ddadf4131f tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: d2380b3f-75da-4c71-9bf5-bc1b1cb0611b] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:15.795937 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9ce8bf10-5d1b-47b2-beac-d0ddadf4131f tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:15.796716 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9ce8bf10-5d1b-47b2-beac-d0ddadf4131f tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:15.798494 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9ce8bf10-5d1b-47b2-beac-d0ddadf4131f tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:15.799578 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9ce8bf10-5d1b-47b2-beac-d0ddadf4131f tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:15.813034 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-ead3d87e-5679-4143-81ae-8ba3bd7913b5 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:15.815979 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-ead3d87e-5679-4143-81ae-8ba3bd7913b5 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:15.822698 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-ead3d87e-5679-4143-81ae-8ba3bd7913b5 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:15.823155 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-ead3d87e-5679-4143-81ae-8ba3bd7913b5 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:15.823956 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-ead3d87e-5679-4143-81ae-8ba3bd7913b5 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:15.824399 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-ead3d87e-5679-4143-81ae-8ba3bd7913b5 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:15.850489 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG dbcounter [-] [124483] Writing DB stats nova_cell1:SELECT=100 {{(pid=124483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:34:16.151538 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-9ce8bf10-5d1b-47b2-beac-d0ddadf4131f tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:16.168769 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-ead3d87e-5679-4143-81ae-8ba3bd7913b5 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:16.176867 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-9ce8bf10-5d1b-47b2-beac-d0ddadf4131f tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/d2380b3f-75da-4c71-9bf5-bc1b1cb0611b" status: 200 len: 1366 microversion: 2.1 time: 0.393198 Jul 28 05:34:16.189829 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-ead3d87e-5679-4143-81ae-8ba3bd7913b5 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:16.191770 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-ead3d87e-5679-4143-81ae-8ba3bd7913b5 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:16.193312 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-ead3d87e-5679-4143-81ae-8ba3bd7913b5 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1720 microversion: 2.20 time: 0.384748 Jul 28 05:34:16.194241 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 193/379] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:34:15 2022] GET /compute/v2.1/servers/d2380b3f-75da-4c71-9bf5-bc1b1cb0611b => generated 1366 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:34:16.199912 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-ffa44da6-5683-4a82-97f1-6040dc9bfb0a tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:16.200738 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-ffa44da6-5683-4a82-97f1-6040dc9bfb0a tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:16.210335 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 187/380] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:34:15 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1720 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:34:16.211002 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ffa44da6-5683-4a82-97f1-6040dc9bfb0a tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:16.211605 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ffa44da6-5683-4a82-97f1-6040dc9bfb0a tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:16.214927 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ffa44da6-5683-4a82-97f1-6040dc9bfb0a tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:16.215728 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ffa44da6-5683-4a82-97f1-6040dc9bfb0a tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:16.273412 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [req-43e647b2-0d3a-4166-a500-e4812934d575 req-1f0a2d25-2e7c-4d87-90a4-39aef898e02e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2380b3f-75da-4c71-9bf5-bc1b1cb0611b", "name": "network-vif-plugged", "status": "completed", "tag": "cd6c58a9-a2f7-4847-b8ea-62033cb3f2f2"}]} {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:34:16.289139 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [req-43e647b2-0d3a-4166-a500-e4812934d575 req-1f0a2d25-2e7c-4d87-90a4-39aef898e02e service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:16.289615 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [req-43e647b2-0d3a-4166-a500-e4812934d575 req-1f0a2d25-2e7c-4d87-90a4-39aef898e02e service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:16.303063 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.compute.server_external_events [req-43e647b2-0d3a-4166-a500-e4812934d575 req-1f0a2d25-2e7c-4d87-90a4-39aef898e02e service nova] Creating event network-vif-plugged:cd6c58a9-a2f7-4847-b8ea-62033cb3f2f2 for instance d2380b3f-75da-4c71-9bf5-bc1b1cb0611b on hv-cinder-79987 Jul 28 05:34:16.309727 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [req-43e647b2-0d3a-4166-a500-e4812934d575 req-1f0a2d25-2e7c-4d87-90a4-39aef898e02e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043160 Jul 28 05:34:16.310337 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 188/381] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:34:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 05:34:16.407050 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-ffa44da6-5683-4a82-97f1-6040dc9bfb0a tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:16.415182 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-ffa44da6-5683-4a82-97f1-6040dc9bfb0a tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 200 len: 1710 microversion: 2.1 time: 0.219694 Jul 28 05:34:16.415931 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 194/382] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:34:16 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 1710 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:34:17.198859 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-2f9890f9-2522-44d5-9c9c-363b2c28a90f tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:17.199528 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-2f9890f9-2522-44d5-9c9c-363b2c28a90f tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: d2380b3f-75da-4c71-9bf5-bc1b1cb0611b] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:17.205816 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-2f9890f9-2522-44d5-9c9c-363b2c28a90f tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:17.206262 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-2f9890f9-2522-44d5-9c9c-363b2c28a90f tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:17.207009 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-2f9890f9-2522-44d5-9c9c-363b2c28a90f tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:17.207438 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-2f9890f9-2522-44d5-9c9c-363b2c28a90f tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:17.220217 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-660ac8dc-5cdd-4b4e-b1a8-641ef02c964d tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:17.220829 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-660ac8dc-5cdd-4b4e-b1a8-641ef02c964d tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:17.227411 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-660ac8dc-5cdd-4b4e-b1a8-641ef02c964d tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:17.227861 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-660ac8dc-5cdd-4b4e-b1a8-641ef02c964d tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:17.229260 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-660ac8dc-5cdd-4b4e-b1a8-641ef02c964d tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:17.229739 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-660ac8dc-5cdd-4b4e-b1a8-641ef02c964d tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:17.413370 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-2f9890f9-2522-44d5-9c9c-363b2c28a90f tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:17.420879 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-660ac8dc-5cdd-4b4e-b1a8-641ef02c964d tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:17.427661 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-2f9890f9-2522-44d5-9c9c-363b2c28a90f tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/d2380b3f-75da-4c71-9bf5-bc1b1cb0611b" status: 200 len: 1366 microversion: 2.1 time: 0.233725 Jul 28 05:34:17.428677 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 189/383] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:34:17 2022] GET /compute/v2.1/servers/d2380b3f-75da-4c71-9bf5-bc1b1cb0611b => generated 1366 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:34:17.429354 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-660ac8dc-5cdd-4b4e-b1a8-641ef02c964d tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:17.431086 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-660ac8dc-5cdd-4b4e-b1a8-641ef02c964d tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:17.432084 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-660ac8dc-5cdd-4b4e-b1a8-641ef02c964d tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1663 microversion: 2.20 time: 0.215850 Jul 28 05:34:17.432905 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 195/384] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:34:17 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1663 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 05:34:17.453165 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-f0c5a05f-c794-4169-9192-4daec3236706 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:17.454104 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-f0c5a05f-c794-4169-9192-4daec3236706 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:17.458621 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-2436eff2-df24-478d-8932-4d69a3e5d2c2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5dcabdf7-8a8e-4c7d-9f9c-954aff561df1"}} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:34:17.460819 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-f0c5a05f-c794-4169-9192-4daec3236706 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:17.461219 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-2436eff2-df24-478d-8932-4d69a3e5d2c2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:17.461325 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-f0c5a05f-c794-4169-9192-4daec3236706 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:17.462841 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-f0c5a05f-c794-4169-9192-4daec3236706 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:17.464020 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-f0c5a05f-c794-4169-9192-4daec3236706 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:17.467960 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2436eff2-df24-478d-8932-4d69a3e5d2c2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:17.472654 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2436eff2-df24-478d-8932-4d69a3e5d2c2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:17.472654 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2436eff2-df24-478d-8932-4d69a3e5d2c2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:17.472654 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2436eff2-df24-478d-8932-4d69a3e5d2c2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:17.552320 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:34:17.628252 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-f0c5a05f-c794-4169-9192-4daec3236706 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:17.637272 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-f0c5a05f-c794-4169-9192-4daec3236706 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 200 len: 1710 microversion: 2.1 time: 0.205182 Jul 28 05:34:17.637945 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 190/385] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:34:17 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 1710 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:34:18.204315 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-08d5309f-5ee8-4613-b94c-a867ed9daff8 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:18.204879 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-08d5309f-5ee8-4613-b94c-a867ed9daff8 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] [instance: 38be4c9a-b055-46f2-a269-f67214cd08ff] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:18.211198 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-08d5309f-5ee8-4613-b94c-a867ed9daff8 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:18.211655 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-08d5309f-5ee8-4613-b94c-a867ed9daff8 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:18.212416 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-08d5309f-5ee8-4613-b94c-a867ed9daff8 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:18.212857 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-08d5309f-5ee8-4613-b94c-a867ed9daff8 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:18.344677 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.objects.instance [None req-08d5309f-5ee8-4613-b94c-a867ed9daff8 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lazy-loading 'services' on Instance uuid 38be4c9a-b055-46f2-a269-f67214cd08ff {{(pid=124483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 05:34:18.607582 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-2436eff2-df24-478d-8932-4d69a3e5d2c2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "POST /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.152561 Jul 28 05:34:18.608759 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 196/386] 10.222.0.33 () {62 vars in 1364 bytes} [Thu Jul 28 05:34:17 2022] POST /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5/os-volume_attachments => generated 188 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 05:34:18.616556 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-08d5309f-5ee8-4613-b94c-a867ed9daff8 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] 10.222.0.33 "DELETE /compute/v2.1/servers/38be4c9a-b055-46f2-a269-f67214cd08ff/os-volume_attachments/4fc14e7a-8a35-448d-86df-70baccd8decf" status: 202 len: 0 microversion: 2.1 time: 0.415541 Jul 28 05:34:18.617127 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-03da8b00-2890-4ecb-9433-2d074907a7d5 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:18.618223 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-03da8b00-2890-4ecb-9433-2d074907a7d5 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: d2380b3f-75da-4c71-9bf5-bc1b1cb0611b] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:18.623499 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 191/387] 10.222.0.33 () {58 vars in 1416 bytes} [Thu Jul 28 05:34:18 2022] DELETE /compute/v2.1/servers/38be4c9a-b055-46f2-a269-f67214cd08ff/os-volume_attachments/4fc14e7a-8a35-448d-86df-70baccd8decf => generated 0 bytes in 424 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 05:34:18.627858 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-03da8b00-2890-4ecb-9433-2d074907a7d5 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:18.629054 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-03da8b00-2890-4ecb-9433-2d074907a7d5 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:18.630820 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-03da8b00-2890-4ecb-9433-2d074907a7d5 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:18.632033 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-03da8b00-2890-4ecb-9433-2d074907a7d5 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:18.669699 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-0aeb7f51-fef2-4340-87b9-2804cf1ccd33 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:18.672269 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-0aeb7f51-fef2-4340-87b9-2804cf1ccd33 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:18.688280 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-0aeb7f51-fef2-4340-87b9-2804cf1ccd33 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:18.689834 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-0aeb7f51-fef2-4340-87b9-2804cf1ccd33 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:18.691849 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-0aeb7f51-fef2-4340-87b9-2804cf1ccd33 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:18.693071 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-0aeb7f51-fef2-4340-87b9-2804cf1ccd33 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:18.906883 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-03da8b00-2890-4ecb-9433-2d074907a7d5 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:18.915543 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-03da8b00-2890-4ecb-9433-2d074907a7d5 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/d2380b3f-75da-4c71-9bf5-bc1b1cb0611b" status: 200 len: 1366 microversion: 2.1 time: 0.304836 Jul 28 05:34:18.916472 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 197/388] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:34:18 2022] GET /compute/v2.1/servers/d2380b3f-75da-4c71-9bf5-bc1b1cb0611b => generated 1366 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:34:18.921962 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-1d2f68fa-1b5a-41f7-91ed-713a916c37f0 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:34:18.922744 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-1d2f68fa-1b5a-41f7-91ed-713a916c37f0 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:18.931375 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1d2f68fa-1b5a-41f7-91ed-713a916c37f0 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:18.932729 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1d2f68fa-1b5a-41f7-91ed-713a916c37f0 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:18.932944 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-0aeb7f51-fef2-4340-87b9-2804cf1ccd33 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:18.933739 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1d2f68fa-1b5a-41f7-91ed-713a916c37f0 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:18.934175 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1d2f68fa-1b5a-41f7-91ed-713a916c37f0 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:18.941653 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-0aeb7f51-fef2-4340-87b9-2804cf1ccd33 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 200 len: 1714 microversion: 2.1 time: 0.283195 Jul 28 05:34:18.942397 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 192/389] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:34:18 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 1714 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:34:18.978303 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-1d2f68fa-1b5a-41f7-91ed-713a916c37f0 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124482) unshelve /opt/stack/nova/nova/compute/api.py:4532}} Jul 28 05:34:19.346459 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-1d2f68fa-1b5a-41f7-91ed-713a916c37f0 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "POST /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5/action" status: 202 len: 0 microversion: 2.20 time: 0.428744 Jul 28 05:34:19.347107 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 198/390] 10.222.0.33 () {62 vars in 1319 bytes} [Thu Jul 28 05:34:18 2022] POST /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5/action => generated 0 bytes in 430 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 05:34:19.356177 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-ea724e34-d4b7-4d4c-aca2-d47bd31dfa67 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:19.356795 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-ea724e34-d4b7-4d4c-aca2-d47bd31dfa67 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:19.363546 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-ea724e34-d4b7-4d4c-aca2-d47bd31dfa67 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:19.364004 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-ea724e34-d4b7-4d4c-aca2-d47bd31dfa67 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:19.364878 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-ea724e34-d4b7-4d4c-aca2-d47bd31dfa67 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:19.365502 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-ea724e34-d4b7-4d4c-aca2-d47bd31dfa67 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:19.506284 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-ea724e34-d4b7-4d4c-aca2-d47bd31dfa67 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:19.516672 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-ea724e34-d4b7-4d4c-aca2-d47bd31dfa67 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:19.518263 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-ea724e34-d4b7-4d4c-aca2-d47bd31dfa67 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:19.521977 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-ea724e34-d4b7-4d4c-aca2-d47bd31dfa67 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1749 microversion: 2.20 time: 0.168023 Jul 28 05:34:19.521977 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 193/391] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:34:19 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1749 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 05:34:19.936588 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-400b06fd-22e6-4496-b10b-68db90fe4df4 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:19.938538 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-400b06fd-22e6-4496-b10b-68db90fe4df4 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: d2380b3f-75da-4c71-9bf5-bc1b1cb0611b] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:19.945426 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-400b06fd-22e6-4496-b10b-68db90fe4df4 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:19.946290 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-400b06fd-22e6-4496-b10b-68db90fe4df4 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:19.947856 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-400b06fd-22e6-4496-b10b-68db90fe4df4 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:19.948400 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-400b06fd-22e6-4496-b10b-68db90fe4df4 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:20.112250 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-400b06fd-22e6-4496-b10b-68db90fe4df4 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:20.121732 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-400b06fd-22e6-4496-b10b-68db90fe4df4 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/d2380b3f-75da-4c71-9bf5-bc1b1cb0611b" status: 200 len: 1556 microversion: 2.1 time: 0.189014 Jul 28 05:34:20.122958 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 199/392] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:34:19 2022] GET /compute/v2.1/servers/d2380b3f-75da-4c71-9bf5-bc1b1cb0611b => generated 1556 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:34:20.142821 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-1b418a4f-1589-4ece-a8ea-038079d077b4 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:20.143312 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-1b418a4f-1589-4ece-a8ea-038079d077b4 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: d2380b3f-75da-4c71-9bf5-bc1b1cb0611b] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:20.149686 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-1b418a4f-1589-4ece-a8ea-038079d077b4 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:20.154484 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-1b418a4f-1589-4ece-a8ea-038079d077b4 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:20.154484 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-1b418a4f-1589-4ece-a8ea-038079d077b4 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:20.154484 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-1b418a4f-1589-4ece-a8ea-038079d077b4 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:20.251537 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-1b418a4f-1589-4ece-a8ea-038079d077b4 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/d2380b3f-75da-4c71-9bf5-bc1b1cb0611b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.112383 Jul 28 05:34:20.252401 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 194/393] 10.222.0.33 () {58 vars in 1275 bytes} [Thu Jul 28 05:34:20 2022] GET /compute/v2.1/servers/d2380b3f-75da-4c71-9bf5-bc1b1cb0611b/os-interface => generated 284 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:34:20.544465 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-38c00963-805b-470b-b334-0d3c7af66a41 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:20.545245 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-38c00963-805b-470b-b334-0d3c7af66a41 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:20.553836 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-38c00963-805b-470b-b334-0d3c7af66a41 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:20.554753 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-38c00963-805b-470b-b334-0d3c7af66a41 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:20.555783 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-38c00963-805b-470b-b334-0d3c7af66a41 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:20.556220 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-38c00963-805b-470b-b334-0d3c7af66a41 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:20.720148 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-38c00963-805b-470b-b334-0d3c7af66a41 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:20.733687 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-38c00963-805b-470b-b334-0d3c7af66a41 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:20.735471 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-38c00963-805b-470b-b334-0d3c7af66a41 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:20.736645 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-38c00963-805b-470b-b334-0d3c7af66a41 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1749 microversion: 2.20 time: 0.197144 Jul 28 05:34:20.737193 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 200/394] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:34:20 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1749 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:34:20.872527 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-8aa2c2d4-0faf-4563-ba49-2905a1231e04 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:20.873698 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-8aa2c2d4-0faf-4563-ba49-2905a1231e04 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] [instance: 38be4c9a-b055-46f2-a269-f67214cd08ff] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:20.879867 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-8aa2c2d4-0faf-4563-ba49-2905a1231e04 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:20.880318 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-8aa2c2d4-0faf-4563-ba49-2905a1231e04 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:20.881122 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-8aa2c2d4-0faf-4563-ba49-2905a1231e04 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:20.881605 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-8aa2c2d4-0faf-4563-ba49-2905a1231e04 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:20.909094 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-8aa2c2d4-0faf-4563-ba49-2905a1231e04 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] [instance: 38be4c9a-b055-46f2-a269-f67214cd08ff] Going to try to terminate instance {{(pid=124483) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 05:34:21.294587 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-8aa2c2d4-0faf-4563-ba49-2905a1231e04 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] 10.222.0.33 "DELETE /compute/v2.1/servers/38be4c9a-b055-46f2-a269-f67214cd08ff" status: 204 len: 0 microversion: 2.1 time: 0.427316 Jul 28 05:34:21.295234 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 195/395] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Jul 28 05:34:20 2022] DELETE /compute/v2.1/servers/38be4c9a-b055-46f2-a269-f67214cd08ff => generated 0 bytes in 429 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 05:34:21.303466 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-1dc2d10e-1a9f-4a50-a297-64191657c686 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:21.304069 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-1dc2d10e-1a9f-4a50-a297-64191657c686 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] [instance: 38be4c9a-b055-46f2-a269-f67214cd08ff] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:21.310642 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1dc2d10e-1a9f-4a50-a297-64191657c686 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:21.311081 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1dc2d10e-1a9f-4a50-a297-64191657c686 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:21.311836 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1dc2d10e-1a9f-4a50-a297-64191657c686 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:21.312260 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1dc2d10e-1a9f-4a50-a297-64191657c686 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:21.448955 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-1dc2d10e-1a9f-4a50-a297-64191657c686 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02142b6537394571912b52f061aeb082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fafe3a7726844018a6c308f8acdbb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:21.456385 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-1dc2d10e-1a9f-4a50-a297-64191657c686 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] 10.222.0.33 "GET /compute/v2.1/servers/38be4c9a-b055-46f2-a269-f67214cd08ff" status: 200 len: 1513 microversion: 2.1 time: 0.156771 Jul 28 05:34:21.456960 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 201/396] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:34:21 2022] GET /compute/v2.1/servers/38be4c9a-b055-46f2-a269-f67214cd08ff => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:34:21.615707 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [req-101d3b92-e4fd-41e9-bb3e-9439dc93fd79 req-4c2d33df-5d38-4b88-91df-bb0cfaac88ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2380b3f-75da-4c71-9bf5-bc1b1cb0611b", "tag": "cd6c58a9-a2f7-4847-b8ea-62033cb3f2f2"}]} {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:34:21.625844 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [req-101d3b92-e4fd-41e9-bb3e-9439dc93fd79 req-4c2d33df-5d38-4b88-91df-bb0cfaac88ce service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:21.626358 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [req-101d3b92-e4fd-41e9-bb3e-9439dc93fd79 req-4c2d33df-5d38-4b88-91df-bb0cfaac88ce service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:21.637395 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.compute.server_external_events [req-101d3b92-e4fd-41e9-bb3e-9439dc93fd79 req-4c2d33df-5d38-4b88-91df-bb0cfaac88ce service nova] Creating event network-changed:cd6c58a9-a2f7-4847-b8ea-62033cb3f2f2 for instance d2380b3f-75da-4c71-9bf5-bc1b1cb0611b on hv-cinder-79987 Jul 28 05:34:21.642650 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [req-101d3b92-e4fd-41e9-bb3e-9439dc93fd79 req-4c2d33df-5d38-4b88-91df-bb0cfaac88ce service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030893 Jul 28 05:34:21.643249 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 196/397] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:34:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:34:21.760172 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-71ed8228-d1d3-46ff-9e11-c0e52e655976 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:21.760883 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-71ed8228-d1d3-46ff-9e11-c0e52e655976 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:21.767525 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-71ed8228-d1d3-46ff-9e11-c0e52e655976 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:21.768037 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-71ed8228-d1d3-46ff-9e11-c0e52e655976 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:21.768793 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-71ed8228-d1d3-46ff-9e11-c0e52e655976 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:21.769234 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-71ed8228-d1d3-46ff-9e11-c0e52e655976 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:21.903699 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-71ed8228-d1d3-46ff-9e11-c0e52e655976 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:21.912678 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-71ed8228-d1d3-46ff-9e11-c0e52e655976 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:21.914364 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-71ed8228-d1d3-46ff-9e11-c0e52e655976 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:21.915406 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-71ed8228-d1d3-46ff-9e11-c0e52e655976 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1751 microversion: 2.20 time: 0.159173 Jul 28 05:34:21.916516 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 202/398] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:34:21 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1751 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:34:22.477077 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-5fd0e2e7-84cd-4f19-8a5d-3cf8ae3b2402 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:22.477875 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-5fd0e2e7-84cd-4f19-8a5d-3cf8ae3b2402 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] [instance: 38be4c9a-b055-46f2-a269-f67214cd08ff] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:22.484867 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-5fd0e2e7-84cd-4f19-8a5d-3cf8ae3b2402 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:22.485655 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-5fd0e2e7-84cd-4f19-8a5d-3cf8ae3b2402 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:22.486520 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-5fd0e2e7-84cd-4f19-8a5d-3cf8ae3b2402 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:22.487031 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-5fd0e2e7-84cd-4f19-8a5d-3cf8ae3b2402 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:22.634349 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-5fd0e2e7-84cd-4f19-8a5d-3cf8ae3b2402 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02142b6537394571912b52f061aeb082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fafe3a7726844018a6c308f8acdbb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:22.642647 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-5fd0e2e7-84cd-4f19-8a5d-3cf8ae3b2402 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] 10.222.0.33 "GET /compute/v2.1/servers/38be4c9a-b055-46f2-a269-f67214cd08ff" status: 200 len: 1513 microversion: 2.1 time: 0.170201 Jul 28 05:34:22.643228 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 197/399] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:34:22 2022] GET /compute/v2.1/servers/38be4c9a-b055-46f2-a269-f67214cd08ff => generated 1513 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:34:22.941002 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-83127172-31bd-42f2-bcf9-178c3bc3c94f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:22.941651 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-83127172-31bd-42f2-bcf9-178c3bc3c94f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:22.948556 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-83127172-31bd-42f2-bcf9-178c3bc3c94f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:22.949009 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-83127172-31bd-42f2-bcf9-178c3bc3c94f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:22.949802 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-83127172-31bd-42f2-bcf9-178c3bc3c94f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:22.950242 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-83127172-31bd-42f2-bcf9-178c3bc3c94f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:23.079222 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-83127172-31bd-42f2-bcf9-178c3bc3c94f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:23.088115 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-83127172-31bd-42f2-bcf9-178c3bc3c94f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:23.089786 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-83127172-31bd-42f2-bcf9-178c3bc3c94f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:23.091032 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-83127172-31bd-42f2-bcf9-178c3bc3c94f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1751 microversion: 2.20 time: 0.153988 Jul 28 05:34:23.091770 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 203/400] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:34:22 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:34:23.664793 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-c3e2fcc0-fcc0-460a-8088-b951bf6fcaaf tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:23.665580 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-c3e2fcc0-fcc0-460a-8088-b951bf6fcaaf tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] [instance: 38be4c9a-b055-46f2-a269-f67214cd08ff] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:23.672287 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-c3e2fcc0-fcc0-460a-8088-b951bf6fcaaf tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:23.672659 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-c3e2fcc0-fcc0-460a-8088-b951bf6fcaaf tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:23.673523 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-c3e2fcc0-fcc0-460a-8088-b951bf6fcaaf tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:23.674051 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-c3e2fcc0-fcc0-460a-8088-b951bf6fcaaf tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:23.875521 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-c3e2fcc0-fcc0-460a-8088-b951bf6fcaaf tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02142b6537394571912b52f061aeb082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fafe3a7726844018a6c308f8acdbb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:23.883478 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-c3e2fcc0-fcc0-460a-8088-b951bf6fcaaf tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] 10.222.0.33 "GET /compute/v2.1/servers/38be4c9a-b055-46f2-a269-f67214cd08ff" status: 200 len: 1513 microversion: 2.1 time: 0.222713 Jul 28 05:34:23.884049 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 198/401] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:34:23 2022] GET /compute/v2.1/servers/38be4c9a-b055-46f2-a269-f67214cd08ff => generated 1513 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:34:24.105851 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-2780a71a-f29b-418b-8d64-76648afe3c60 req-89e9c69d-b330-4bd9-b662-f936951207c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38be4c9a-b055-46f2-a269-f67214cd08ff", "name": "network-vif-deleted", "tag": "f2e46983-fbb4-4369-a1ec-16bd6bc4d642"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:34:24.115092 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-c107712e-6f1d-467d-a20d-65b46630cf1e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:24.115845 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-c107712e-6f1d-467d-a20d-65b46630cf1e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:24.116003 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-2780a71a-f29b-418b-8d64-76648afe3c60 req-89e9c69d-b330-4bd9-b662-f936951207c7 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:24.116720 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-2780a71a-f29b-418b-8d64-76648afe3c60 req-89e9c69d-b330-4bd9-b662-f936951207c7 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:24.122906 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-c107712e-6f1d-467d-a20d-65b46630cf1e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:24.123357 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-c107712e-6f1d-467d-a20d-65b46630cf1e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:24.124119 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-c107712e-6f1d-467d-a20d-65b46630cf1e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:24.124556 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-c107712e-6f1d-467d-a20d-65b46630cf1e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:24.128573 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-2780a71a-f29b-418b-8d64-76648afe3c60 req-89e9c69d-b330-4bd9-b662-f936951207c7 service nova] Creating event network-vif-deleted:f2e46983-fbb4-4369-a1ec-16bd6bc4d642 for instance 38be4c9a-b055-46f2-a269-f67214cd08ff on hv-cinder-79987 Jul 28 05:34:24.134048 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-2780a71a-f29b-418b-8d64-76648afe3c60 req-89e9c69d-b330-4bd9-b662-f936951207c7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031960 Jul 28 05:34:24.135351 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 204/402] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:34:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:34:24.263305 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-c107712e-6f1d-467d-a20d-65b46630cf1e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:24.273375 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-c107712e-6f1d-467d-a20d-65b46630cf1e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:24.274943 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-c107712e-6f1d-467d-a20d-65b46630cf1e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:24.276693 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-c107712e-6f1d-467d-a20d-65b46630cf1e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1751 microversion: 2.20 time: 0.165689 Jul 28 05:34:24.277259 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 199/403] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:34:24 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1751 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 05:34:24.906598 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-e73a5ce2-fd52-4df3-b3e2-7da605645cd8 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:24.907297 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-e73a5ce2-fd52-4df3-b3e2-7da605645cd8 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] [instance: 38be4c9a-b055-46f2-a269-f67214cd08ff] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:24.913818 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e73a5ce2-fd52-4df3-b3e2-7da605645cd8 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:24.922021 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e73a5ce2-fd52-4df3-b3e2-7da605645cd8 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:24.922888 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e73a5ce2-fd52-4df3-b3e2-7da605645cd8 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:24.923335 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e73a5ce2-fd52-4df3-b3e2-7da605645cd8 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:24.954585 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e73a5ce2-fd52-4df3-b3e2-7da605645cd8 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:24.955031 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e73a5ce2-fd52-4df3-b3e2-7da605645cd8 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:24.955477 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.objects.instance [None req-e73a5ce2-fd52-4df3-b3e2-7da605645cd8 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lazy-loading 'fault' on Instance uuid 38be4c9a-b055-46f2-a269-f67214cd08ff {{(pid=124482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 05:34:25.004988 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-e73a5ce2-fd52-4df3-b3e2-7da605645cd8 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02142b6537394571912b52f061aeb082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fafe3a7726844018a6c308f8acdbb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:25.012379 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-e73a5ce2-fd52-4df3-b3e2-7da605645cd8 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] 10.222.0.33 "GET /compute/v2.1/servers/38be4c9a-b055-46f2-a269-f67214cd08ff" status: 200 len: 1309 microversion: 2.1 time: 0.109974 Jul 28 05:34:25.012949 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 205/404] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:34:24 2022] GET /compute/v2.1/servers/38be4c9a-b055-46f2-a269-f67214cd08ff => generated 1309 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:34:25.301368 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-57604a51-88a1-49f3-8378-6c3f6ebf910a tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:25.302016 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-57604a51-88a1-49f3-8378-6c3f6ebf910a tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:25.308656 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-57604a51-88a1-49f3-8378-6c3f6ebf910a tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:25.309106 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-57604a51-88a1-49f3-8378-6c3f6ebf910a tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:25.309900 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-57604a51-88a1-49f3-8378-6c3f6ebf910a tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:25.311623 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-57604a51-88a1-49f3-8378-6c3f6ebf910a tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:25.444593 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-57604a51-88a1-49f3-8378-6c3f6ebf910a tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:25.453966 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-57604a51-88a1-49f3-8378-6c3f6ebf910a tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:25.455480 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-57604a51-88a1-49f3-8378-6c3f6ebf910a tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:25.456716 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-57604a51-88a1-49f3-8378-6c3f6ebf910a tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1807 microversion: 2.20 time: 0.159455 Jul 28 05:34:25.457288 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 200/405] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:34:25 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:34:26.037155 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-2cbb80b1-d040-4e66-9535-fdcf8b61a57d tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:26.038261 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-2cbb80b1-d040-4e66-9535-fdcf8b61a57d tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] [instance: 38be4c9a-b055-46f2-a269-f67214cd08ff] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:26.047039 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2cbb80b1-d040-4e66-9535-fdcf8b61a57d tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:26.047680 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2cbb80b1-d040-4e66-9535-fdcf8b61a57d tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:26.048467 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2cbb80b1-d040-4e66-9535-fdcf8b61a57d tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:26.048907 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2cbb80b1-d040-4e66-9535-fdcf8b61a57d tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:26.069864 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.wsgi [None req-2cbb80b1-d040-4e66-9535-fdcf8b61a57d tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] HTTP exception thrown: Instance 38be4c9a-b055-46f2-a269-f67214cd08ff could not be found. Jul 28 05:34:26.071529 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-2cbb80b1-d040-4e66-9535-fdcf8b61a57d tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Request method failure captured: Jul 28 05:34:26.071529 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: request: GET /compute/v2.1/servers/38be4c9a-b055-46f2-a269-f67214cd08ff HTTP/1.1 Jul 28 05:34:26.071529 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept: application/json Jul 28 05:34:26.071529 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept-Encoding: identity Jul 28 05:34:26.071529 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Connection: close Jul 28 05:34:26.071529 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Length: 0 Jul 28 05:34:26.071529 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Type: application/json Jul 28 05:34:26.071529 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Host: 10.222.0.33 Jul 28 05:34:26.071529 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Openstack-System-Scope: None Jul 28 05:34:26.071529 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: User-Agent: python-urllib3/1.26.10 Jul 28 05:34:26.071529 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Auth-Token: gAAAAABi4h9-mfoXU7i0Xn7mAnk0nvB4d43Vw0PLNX-Nilniu-7Tis7jDXlDZSb6sM8ZlpFbDSpgDOpa-gxCY0Cfr7Ka5DsmgBLCwaq8ai8MtTo65sPxUHoK6ViFhBr_a0vKUXVg0t_tOGUxV0gUwxugqQggtGyA-L886lZKp7DEJhxmcutGtoY Jul 28 05:34:26.071529 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Id: None Jul 28 05:34:26.071529 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Name: None Jul 28 05:34:26.071529 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Identity-Status: Confirmed Jul 28 05:34:26.071529 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Is-Admin-Project: True Jul 28 05:34:26.071529 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Id: default Jul 28 05:34:26.071529 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Name: Default Jul 28 05:34:26.071529 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Id: 0fafe3a7726844018a6c308f8acdbb49 Jul 28 05:34:26.071529 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Name: tempest-VolumesSnapshotTestJSON-451779272 Jul 28 05:34:26.071529 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Role: member,reader Jul 28 05:34:26.071529 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Roles: member,reader Jul 28 05:34:26.072822 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0fafe3a7726844018a6c308f8acdbb49"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0fafe3a7726844018a6c308f8acdbb49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0fafe3a7726844018a6c308f8acdbb49", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0fafe3a7726844018a6c308f8acdbb49"}]}] Jul 28 05:34:26.072822 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant: tempest-VolumesSnapshotTestJSON-451779272 Jul 28 05:34:26.072822 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Id: 0fafe3a7726844018a6c308f8acdbb49 Jul 28 05:34:26.072822 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-451779272 Jul 28 05:34:26.072822 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User: tempest-VolumesSnapshotTestJSON-451779272-project Jul 28 05:34:26.072822 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Id: default Jul 28 05:34:26.072822 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Name: Default Jul 28 05:34:26.072822 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Id: 02142b6537394571912b52f061aeb082 Jul 28 05:34:26.072822 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Name: tempest-VolumesSnapshotTestJSON-451779272-project Jul 28 05:34:26.072822 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: method: > Jul 28 05:34:26.072822 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: exception: Instance 38be4c9a-b055-46f2-a269-f67214cd08ff could not be found. Jul 28 05:34:26.072822 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: action_args: {'id': '38be4c9a-b055-46f2-a269-f67214cd08ff'} Jul 28 05:34:26.073865 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 05:34:26.073865 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:34:26.073865 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 05:34:26.073865 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 05:34:26.073865 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 05:34:26.073865 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 05:34:26.073865 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 05:34:26.073865 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 05:34:26.073865 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 05:34:26.073865 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 05:34:26.073865 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38be4c9a-b055-46f2-a269-f67214cd08ff could not be found. Jul 28 05:34:26.073865 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:34:26.073865 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:34:26.073865 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:34:26.073865 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:34:26.073865 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:34:26.073865 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:34:26.073865 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 05:34:26.073865 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 05:34:26.073865 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 05:34:26.074980 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:34:26.074980 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 05:34:26.074980 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 05:34:26.074980 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 05:34:26.074980 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 05:34:26.074980 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 05:34:26.074980 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 05:34:26.074980 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38be4c9a-b055-46f2-a269-f67214cd08ff could not be found. Jul 28 05:34:26.074980 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:34:26.074980 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:34:26.074980 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:34:26.074980 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:34:26.074980 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:34:26.074980 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:34:26.074980 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 05:34:26.074980 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 05:34:26.074980 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38be4c9a-b055-46f2-a269-f67214cd08ff could not be found. Jul 28 05:34:26.074980 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:34:26.078359 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-2cbb80b1-d040-4e66-9535-fdcf8b61a57d tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Returning 404 to user: Instance 38be4c9a-b055-46f2-a269-f67214cd08ff could not be found. {{(pid=124482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 05:34:26.079867 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-2cbb80b1-d040-4e66-9535-fdcf8b61a57d tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] 10.222.0.33 "GET /compute/v2.1/servers/38be4c9a-b055-46f2-a269-f67214cd08ff" status: 404 len: 111 microversion: 2.1 time: 0.047925 Jul 28 05:34:26.080774 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 206/406] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:34:26 2022] GET /compute/v2.1/servers/38be4c9a-b055-46f2-a269-f67214cd08ff => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 05:34:26.481000 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-c7b6a2ba-97ff-41d9-9470-26576ba62a12 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:26.488984 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-c7b6a2ba-97ff-41d9-9470-26576ba62a12 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:26.496718 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-c7b6a2ba-97ff-41d9-9470-26576ba62a12 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:26.497393 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-c7b6a2ba-97ff-41d9-9470-26576ba62a12 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:26.498739 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-c7b6a2ba-97ff-41d9-9470-26576ba62a12 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:26.499668 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-c7b6a2ba-97ff-41d9-9470-26576ba62a12 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:26.659338 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-c7b6a2ba-97ff-41d9-9470-26576ba62a12 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:26.668870 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-c7b6a2ba-97ff-41d9-9470-26576ba62a12 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:26.670456 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-c7b6a2ba-97ff-41d9-9470-26576ba62a12 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:26.671676 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-c7b6a2ba-97ff-41d9-9470-26576ba62a12 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1807 microversion: 2.20 time: 0.194734 Jul 28 05:34:26.672244 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 201/407] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:34:26 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1807 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:34:27.695370 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-9efbab92-cd97-47e9-8f6c-8d3e70a4e0e8 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:27.698569 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-9efbab92-cd97-47e9-8f6c-8d3e70a4e0e8 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:27.705222 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9efbab92-cd97-47e9-8f6c-8d3e70a4e0e8 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:27.705222 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9efbab92-cd97-47e9-8f6c-8d3e70a4e0e8 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:27.705222 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9efbab92-cd97-47e9-8f6c-8d3e70a4e0e8 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:27.705222 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9efbab92-cd97-47e9-8f6c-8d3e70a4e0e8 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:27.867759 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-9efbab92-cd97-47e9-8f6c-8d3e70a4e0e8 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:27.882882 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-9efbab92-cd97-47e9-8f6c-8d3e70a4e0e8 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:27.882882 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-9efbab92-cd97-47e9-8f6c-8d3e70a4e0e8 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:27.882882 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-9efbab92-cd97-47e9-8f6c-8d3e70a4e0e8 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1807 microversion: 2.20 time: 0.191094 Jul 28 05:34:27.884090 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 207/408] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:34:27 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1807 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:34:28.908747 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-2f85fb68-ccd4-4d7a-bf36-cb65ad86e445 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:28.909368 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-2f85fb68-ccd4-4d7a-bf36-cb65ad86e445 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:28.916551 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-2f85fb68-ccd4-4d7a-bf36-cb65ad86e445 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:28.917261 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-2f85fb68-ccd4-4d7a-bf36-cb65ad86e445 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:28.918172 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-2f85fb68-ccd4-4d7a-bf36-cb65ad86e445 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:28.918614 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-2f85fb68-ccd4-4d7a-bf36-cb65ad86e445 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:29.314579 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-2f85fb68-ccd4-4d7a-bf36-cb65ad86e445 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:29.323918 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-2f85fb68-ccd4-4d7a-bf36-cb65ad86e445 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:29.325418 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-2f85fb68-ccd4-4d7a-bf36-cb65ad86e445 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:29.326606 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-2f85fb68-ccd4-4d7a-bf36-cb65ad86e445 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1807 microversion: 2.20 time: 0.422824 Jul 28 05:34:29.327164 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 202/409] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:34:28 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1807 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:34:30.350237 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-da736508-4e0c-44a1-9adf-5b14b66e472e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:30.350864 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-da736508-4e0c-44a1-9adf-5b14b66e472e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:30.354217 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:34:30.359221 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-da736508-4e0c-44a1-9adf-5b14b66e472e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:30.359898 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-da736508-4e0c-44a1-9adf-5b14b66e472e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:30.360678 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-da736508-4e0c-44a1-9adf-5b14b66e472e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:30.361115 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-da736508-4e0c-44a1-9adf-5b14b66e472e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:30.509848 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-da736508-4e0c-44a1-9adf-5b14b66e472e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:30.519777 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-da736508-4e0c-44a1-9adf-5b14b66e472e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:30.522154 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-da736508-4e0c-44a1-9adf-5b14b66e472e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:30.523871 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-da736508-4e0c-44a1-9adf-5b14b66e472e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1807 microversion: 2.20 time: 0.177492 Jul 28 05:34:30.525496 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 208/410] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:34:30 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:34:31.548456 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-9df6dbd3-7ea6-4d5e-9be7-82cec0237bd0 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:31.549818 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-9df6dbd3-7ea6-4d5e-9be7-82cec0237bd0 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:31.558715 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-9df6dbd3-7ea6-4d5e-9be7-82cec0237bd0 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:31.559163 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-9df6dbd3-7ea6-4d5e-9be7-82cec0237bd0 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:31.559945 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-9df6dbd3-7ea6-4d5e-9be7-82cec0237bd0 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:31.560384 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-9df6dbd3-7ea6-4d5e-9be7-82cec0237bd0 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:31.580295 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG dbcounter [-] [124483] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:34:31.725536 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-9df6dbd3-7ea6-4d5e-9be7-82cec0237bd0 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:31.725536 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-9df6dbd3-7ea6-4d5e-9be7-82cec0237bd0 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:31.726466 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-9df6dbd3-7ea6-4d5e-9be7-82cec0237bd0 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:31.726466 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-9df6dbd3-7ea6-4d5e-9be7-82cec0237bd0 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1807 microversion: 2.20 time: 0.179456 Jul 28 05:34:31.738028 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 203/411] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:34:31 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1807 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:34:32.749055 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-f11e0a08-cbb6-4450-9bc8-d87f7080647b tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:32.749694 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-f11e0a08-cbb6-4450-9bc8-d87f7080647b tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:32.759327 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f11e0a08-cbb6-4450-9bc8-d87f7080647b tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:32.759327 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f11e0a08-cbb6-4450-9bc8-d87f7080647b tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:32.759615 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f11e0a08-cbb6-4450-9bc8-d87f7080647b tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:32.760379 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f11e0a08-cbb6-4450-9bc8-d87f7080647b tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:32.963620 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-f11e0a08-cbb6-4450-9bc8-d87f7080647b tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:32.974787 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-f11e0a08-cbb6-4450-9bc8-d87f7080647b tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:32.976872 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-f11e0a08-cbb6-4450-9bc8-d87f7080647b tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:32.979112 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-f11e0a08-cbb6-4450-9bc8-d87f7080647b tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1807 microversion: 2.20 time: 0.234709 Jul 28 05:34:32.980609 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 209/412] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:34:32 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1807 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:34:34.011464 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-907d811d-c228-4ca5-9a80-aac5282f69a6 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:34.012096 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-907d811d-c228-4ca5-9a80-aac5282f69a6 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:34.014483 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG dbcounter [-] [124483] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=124483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:34:34.019503 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-907d811d-c228-4ca5-9a80-aac5282f69a6 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:34.020018 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-907d811d-c228-4ca5-9a80-aac5282f69a6 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:34.021240 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-907d811d-c228-4ca5-9a80-aac5282f69a6 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:34.021677 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-907d811d-c228-4ca5-9a80-aac5282f69a6 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:34.164180 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-907d811d-c228-4ca5-9a80-aac5282f69a6 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:34.170053 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-907d811d-c228-4ca5-9a80-aac5282f69a6 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:34.171619 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-907d811d-c228-4ca5-9a80-aac5282f69a6 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:34.172766 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-907d811d-c228-4ca5-9a80-aac5282f69a6 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1807 microversion: 2.20 time: 0.166581 Jul 28 05:34:34.173335 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 204/413] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:34:34 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:34:35.196253 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-647f1037-2746-47ad-8905-0163d4bf1be6 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:35.197608 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-647f1037-2746-47ad-8905-0163d4bf1be6 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:35.206028 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-647f1037-2746-47ad-8905-0163d4bf1be6 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:35.206479 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-647f1037-2746-47ad-8905-0163d4bf1be6 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:35.207261 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-647f1037-2746-47ad-8905-0163d4bf1be6 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:35.207726 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-647f1037-2746-47ad-8905-0163d4bf1be6 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:35.372777 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-647f1037-2746-47ad-8905-0163d4bf1be6 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:35.382320 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-647f1037-2746-47ad-8905-0163d4bf1be6 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:35.383834 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-647f1037-2746-47ad-8905-0163d4bf1be6 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:35.385641 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-647f1037-2746-47ad-8905-0163d4bf1be6 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1807 microversion: 2.20 time: 0.193444 Jul 28 05:34:35.386406 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 210/414] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:34:35 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1807 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:34:36.410485 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-db1160cd-413d-44a9-83ae-48ecb12b77de tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:36.411101 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-db1160cd-413d-44a9-83ae-48ecb12b77de tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:36.420496 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-db1160cd-413d-44a9-83ae-48ecb12b77de tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:36.420945 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-db1160cd-413d-44a9-83ae-48ecb12b77de tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:36.423132 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-db1160cd-413d-44a9-83ae-48ecb12b77de tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:36.423616 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-db1160cd-413d-44a9-83ae-48ecb12b77de tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:36.566557 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-db1160cd-413d-44a9-83ae-48ecb12b77de tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:36.575789 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-db1160cd-413d-44a9-83ae-48ecb12b77de tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:36.577609 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-db1160cd-413d-44a9-83ae-48ecb12b77de tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:36.578782 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-db1160cd-413d-44a9-83ae-48ecb12b77de tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1807 microversion: 2.20 time: 0.172381 Jul 28 05:34:36.579708 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 205/415] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:34:36 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:34:37.082287 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-9e647f3c-0155-4824-a6ea-40e49cdd5338 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-592765939", "imageRef": "4f0ce061-6677-4c2a-9ee1-54a100f21462", "flavorRef": "452", "networks": [{"uuid": "6e095ba2-9c3e-4bcc-b330-5cb1fbb72ecf"}]}} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:34:37.138593 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.network.neutron [None req-9e647f3c-0155-4824-a6ea-40e49cdd5338 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] validate_networks() for [('6e095ba2-9c3e-4bcc-b330-5cb1fbb72ecf', None, None, None, None, None)] {{(pid=124482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 05:34:37.488007 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-9e647f3c-0155-4824-a6ea-40e49cdd5338 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Flavor limits 0:0:0 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 05:34:37.488434 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-9e647f3c-0155-4824-a6ea-40e49cdd5338 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Image limits 0:0:0 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 05:34:37.488926 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-9e647f3c-0155-4824-a6ea-40e49cdd5338 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Flavor pref 0:0:0 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 05:34:37.489363 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-9e647f3c-0155-4824-a6ea-40e49cdd5338 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Image pref 0:0:0 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 05:34:37.489814 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-9e647f3c-0155-4824-a6ea-40e49cdd5338 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 05:34:37.499559 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9e647f3c-0155-4824-a6ea-40e49cdd5338 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:37.499997 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9e647f3c-0155-4824-a6ea-40e49cdd5338 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:37.500778 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9e647f3c-0155-4824-a6ea-40e49cdd5338 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:37.501209 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9e647f3c-0155-4824-a6ea-40e49cdd5338 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:37.507962 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell1:INSERT=4,nova_cell1:SELECT=91,nova_cell1:UPDATE=5 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:34:37.518774 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.quota [None req-9e647f3c-0155-4824-a6ea-40e49cdd5338 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Getting quotas for project 0fafe3a7726844018a6c308f8acdbb49. Resources: {'ram', 'instances', 'cores'} {{(pid=124482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 05:34:37.523192 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.quota [None req-9e647f3c-0155-4824-a6ea-40e49cdd5338 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Getting quotas for user 02142b6537394571912b52f061aeb082 and project 0fafe3a7726844018a6c308f8acdbb49. Resources: {'ram', 'instances', 'cores'} {{(pid=124482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 05:34:37.534588 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-9e647f3c-0155-4824-a6ea-40e49cdd5338 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Going to run 1 instances... {{(pid=124482) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 05:34:37.536835 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-9e647f3c-0155-4824-a6ea-40e49cdd5338 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] [instance: 2c4200ea-e29d-4c22-bc72-174b478b18fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f0ce061-6677-4c2a-9ee1-54a100f21462',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 05:34:37.602161 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-d6f5b1ed-677a-4f8e-a931-58fe78dcc64d tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:37.602984 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-d6f5b1ed-677a-4f8e-a931-58fe78dcc64d tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:37.609409 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-d6f5b1ed-677a-4f8e-a931-58fe78dcc64d tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:37.609912 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-d6f5b1ed-677a-4f8e-a931-58fe78dcc64d tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:37.610679 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-d6f5b1ed-677a-4f8e-a931-58fe78dcc64d tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:37.611114 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-d6f5b1ed-677a-4f8e-a931-58fe78dcc64d tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:37.679710 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-9e647f3c-0155-4824-a6ea-40e49cdd5338 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.601262 Jul 28 05:34:37.692225 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 211/416] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Jul 28 05:34:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 05:34:37.694750 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-00a6d995-5d89-404b-b25a-acb1480b492e tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:37.695431 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-00a6d995-5d89-404b-b25a-acb1480b492e tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] [instance: 2c4200ea-e29d-4c22-bc72-174b478b18fe] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:37.793905 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-00a6d995-5d89-404b-b25a-acb1480b492e tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02142b6537394571912b52f061aeb082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fafe3a7726844018a6c308f8acdbb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:37.802194 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-00a6d995-5d89-404b-b25a-acb1480b492e tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] 10.222.0.33 "GET /compute/v2.1/servers/2c4200ea-e29d-4c22-bc72-174b478b18fe" status: 200 len: 1218 microversion: 2.1 time: 0.111634 Jul 28 05:34:37.802675 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 212/417] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:34:37 2022] GET /compute/v2.1/servers/2c4200ea-e29d-4c22-bc72-174b478b18fe => generated 1218 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:34:37.844019 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-d6f5b1ed-677a-4f8e-a931-58fe78dcc64d tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:37.854538 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-d6f5b1ed-677a-4f8e-a931-58fe78dcc64d tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:37.859795 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-d6f5b1ed-677a-4f8e-a931-58fe78dcc64d tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:37.859795 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-d6f5b1ed-677a-4f8e-a931-58fe78dcc64d tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1807 microversion: 2.20 time: 0.259380 Jul 28 05:34:37.859795 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 206/418] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:34:37 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1807 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 05:34:38.823076 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-14326bf8-b006-4673-ac26-b3d59bbbb518 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:38.824674 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-14326bf8-b006-4673-ac26-b3d59bbbb518 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] [instance: 2c4200ea-e29d-4c22-bc72-174b478b18fe] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:38.831969 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-14326bf8-b006-4673-ac26-b3d59bbbb518 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:38.832715 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-14326bf8-b006-4673-ac26-b3d59bbbb518 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:38.833686 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-14326bf8-b006-4673-ac26-b3d59bbbb518 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:38.834504 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-14326bf8-b006-4673-ac26-b3d59bbbb518 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:38.883647 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-703e9350-8ec4-434b-bded-8de9e96be304 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:38.884443 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-703e9350-8ec4-434b-bded-8de9e96be304 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:38.898364 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-703e9350-8ec4-434b-bded-8de9e96be304 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:38.899527 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-703e9350-8ec4-434b-bded-8de9e96be304 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:38.900347 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-703e9350-8ec4-434b-bded-8de9e96be304 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:38.900876 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-703e9350-8ec4-434b-bded-8de9e96be304 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:38.905576 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-14326bf8-b006-4673-ac26-b3d59bbbb518 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02142b6537394571912b52f061aeb082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fafe3a7726844018a6c308f8acdbb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:38.917883 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-14326bf8-b006-4673-ac26-b3d59bbbb518 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] 10.222.0.33 "GET /compute/v2.1/servers/2c4200ea-e29d-4c22-bc72-174b478b18fe" status: 200 len: 1222 microversion: 2.1 time: 0.098870 Jul 28 05:34:38.919041 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 213/419] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:34:38 2022] GET /compute/v2.1/servers/2c4200ea-e29d-4c22-bc72-174b478b18fe => generated 1222 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:34:39.057878 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-703e9350-8ec4-434b-bded-8de9e96be304 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:39.066451 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-703e9350-8ec4-434b-bded-8de9e96be304 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:39.068005 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-703e9350-8ec4-434b-bded-8de9e96be304 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:39.069150 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-703e9350-8ec4-434b-bded-8de9e96be304 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1807 microversion: 2.20 time: 0.190005 Jul 28 05:34:39.069754 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 207/420] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:34:38 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1807 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 05:34:39.939510 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-68536619-8ea8-486e-b454-9a1f1ae39aa9 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:39.940124 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-68536619-8ea8-486e-b454-9a1f1ae39aa9 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] [instance: 2c4200ea-e29d-4c22-bc72-174b478b18fe] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:39.946631 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-68536619-8ea8-486e-b454-9a1f1ae39aa9 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:39.947085 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-68536619-8ea8-486e-b454-9a1f1ae39aa9 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:39.947883 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-68536619-8ea8-486e-b454-9a1f1ae39aa9 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:39.948318 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-68536619-8ea8-486e-b454-9a1f1ae39aa9 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:40.015950 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-68536619-8ea8-486e-b454-9a1f1ae39aa9 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02142b6537394571912b52f061aeb082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fafe3a7726844018a6c308f8acdbb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:40.023778 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-68536619-8ea8-486e-b454-9a1f1ae39aa9 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] 10.222.0.33 "GET /compute/v2.1/servers/2c4200ea-e29d-4c22-bc72-174b478b18fe" status: 200 len: 1270 microversion: 2.1 time: 0.088629 Jul 28 05:34:40.026267 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 214/421] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:34:39 2022] GET /compute/v2.1/servers/2c4200ea-e29d-4c22-bc72-174b478b18fe => generated 1270 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:34:40.092993 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-c700ab7c-15ac-4b22-b28e-2139b7096e39 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:40.093638 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-c700ab7c-15ac-4b22-b28e-2139b7096e39 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:40.100366 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-c700ab7c-15ac-4b22-b28e-2139b7096e39 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:40.100877 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-c700ab7c-15ac-4b22-b28e-2139b7096e39 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:40.101908 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-c700ab7c-15ac-4b22-b28e-2139b7096e39 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:40.102091 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-c700ab7c-15ac-4b22-b28e-2139b7096e39 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:40.241688 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-c700ab7c-15ac-4b22-b28e-2139b7096e39 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:40.250276 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-c700ab7c-15ac-4b22-b28e-2139b7096e39 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:40.251827 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-c700ab7c-15ac-4b22-b28e-2139b7096e39 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:40.252998 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-c700ab7c-15ac-4b22-b28e-2139b7096e39 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1807 microversion: 2.20 time: 0.164140 Jul 28 05:34:40.253580 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 208/422] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:34:40 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 05:34:41.045978 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-8de1ed0a-18bf-4ee7-91ab-a0fa8a8be7e9 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:41.046605 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-8de1ed0a-18bf-4ee7-91ab-a0fa8a8be7e9 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] [instance: 2c4200ea-e29d-4c22-bc72-174b478b18fe] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:41.053146 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8de1ed0a-18bf-4ee7-91ab-a0fa8a8be7e9 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:41.053626 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8de1ed0a-18bf-4ee7-91ab-a0fa8a8be7e9 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:41.054387 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8de1ed0a-18bf-4ee7-91ab-a0fa8a8be7e9 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:41.054842 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8de1ed0a-18bf-4ee7-91ab-a0fa8a8be7e9 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:41.196999 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-8de1ed0a-18bf-4ee7-91ab-a0fa8a8be7e9 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02142b6537394571912b52f061aeb082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fafe3a7726844018a6c308f8acdbb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:41.205409 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-8de1ed0a-18bf-4ee7-91ab-a0fa8a8be7e9 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] 10.222.0.33 "GET /compute/v2.1/servers/2c4200ea-e29d-4c22-bc72-174b478b18fe" status: 200 len: 1318 microversion: 2.1 time: 0.163539 Jul 28 05:34:41.220453 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 215/423] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:34:41 2022] GET /compute/v2.1/servers/2c4200ea-e29d-4c22-bc72-174b478b18fe => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:34:41.277451 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-a6920368-820a-4824-83da-a8db9c09dcd3 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:41.278093 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-a6920368-820a-4824-83da-a8db9c09dcd3 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:41.284624 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-a6920368-820a-4824-83da-a8db9c09dcd3 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:41.285043 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-a6920368-820a-4824-83da-a8db9c09dcd3 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:41.285917 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-a6920368-820a-4824-83da-a8db9c09dcd3 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:41.286357 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-a6920368-820a-4824-83da-a8db9c09dcd3 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:41.425039 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-a6920368-820a-4824-83da-a8db9c09dcd3 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:41.433642 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-a6920368-820a-4824-83da-a8db9c09dcd3 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:41.435157 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-a6920368-820a-4824-83da-a8db9c09dcd3 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:41.436324 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-a6920368-820a-4824-83da-a8db9c09dcd3 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1807 microversion: 2.20 time: 0.163721 Jul 28 05:34:41.436890 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 209/424] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:34:41 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:34:41.937782 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-cd24861a-44fb-4ecd-83c7-748ffd3ab9a8 req-1dfd5c51-7bfe-480b-9263-566a138e2468 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c4200ea-e29d-4c22-bc72-174b478b18fe", "tag": "ad525c4e-158a-4aa3-9d2c-e4f773a1dd4b"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:34:41.948177 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-cd24861a-44fb-4ecd-83c7-748ffd3ab9a8 req-1dfd5c51-7bfe-480b-9263-566a138e2468 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:41.948910 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-cd24861a-44fb-4ecd-83c7-748ffd3ab9a8 req-1dfd5c51-7bfe-480b-9263-566a138e2468 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:41.960135 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-cd24861a-44fb-4ecd-83c7-748ffd3ab9a8 req-1dfd5c51-7bfe-480b-9263-566a138e2468 service nova] Creating event network-changed:ad525c4e-158a-4aa3-9d2c-e4f773a1dd4b for instance 2c4200ea-e29d-4c22-bc72-174b478b18fe on hv-cinder-79987 Jul 28 05:34:41.965575 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-cd24861a-44fb-4ecd-83c7-748ffd3ab9a8 req-1dfd5c51-7bfe-480b-9263-566a138e2468 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031410 Jul 28 05:34:41.966171 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 216/425] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:34:42.227539 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-e358f408-fb4e-439d-b590-df3bde725fb9 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:42.227759 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-e358f408-fb4e-439d-b590-df3bde725fb9 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] [instance: 2c4200ea-e29d-4c22-bc72-174b478b18fe] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:42.234373 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-e358f408-fb4e-439d-b590-df3bde725fb9 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:42.234817 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-e358f408-fb4e-439d-b590-df3bde725fb9 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:42.235589 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-e358f408-fb4e-439d-b590-df3bde725fb9 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:42.236015 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-e358f408-fb4e-439d-b590-df3bde725fb9 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:42.406786 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-e358f408-fb4e-439d-b590-df3bde725fb9 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02142b6537394571912b52f061aeb082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fafe3a7726844018a6c308f8acdbb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:42.414379 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-e358f408-fb4e-439d-b590-df3bde725fb9 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] 10.222.0.33 "GET /compute/v2.1/servers/2c4200ea-e29d-4c22-bc72-174b478b18fe" status: 200 len: 1318 microversion: 2.1 time: 0.190981 Jul 28 05:34:42.415958 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 210/426] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:34:42 2022] GET /compute/v2.1/servers/2c4200ea-e29d-4c22-bc72-174b478b18fe => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:34:42.462377 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-4473d84d-e91e-4923-9b95-5f8df7e14f22 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:42.463429 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-4473d84d-e91e-4923-9b95-5f8df7e14f22 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:42.469996 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4473d84d-e91e-4923-9b95-5f8df7e14f22 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:42.470566 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4473d84d-e91e-4923-9b95-5f8df7e14f22 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:42.471433 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4473d84d-e91e-4923-9b95-5f8df7e14f22 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:42.472040 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4473d84d-e91e-4923-9b95-5f8df7e14f22 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:42.673048 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-4473d84d-e91e-4923-9b95-5f8df7e14f22 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:42.682527 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-4473d84d-e91e-4923-9b95-5f8df7e14f22 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:42.684064 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-4473d84d-e91e-4923-9b95-5f8df7e14f22 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:42.685449 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-4473d84d-e91e-4923-9b95-5f8df7e14f22 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1807 microversion: 2.20 time: 0.228055 Jul 28 05:34:42.686031 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 217/427] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:34:42 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1807 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:34:43.436246 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-456718e0-f4e3-40f5-bf44-063f7a9bbbc1 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:43.436875 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-456718e0-f4e3-40f5-bf44-063f7a9bbbc1 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] [instance: 2c4200ea-e29d-4c22-bc72-174b478b18fe] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:43.443340 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-456718e0-f4e3-40f5-bf44-063f7a9bbbc1 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:43.443781 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-456718e0-f4e3-40f5-bf44-063f7a9bbbc1 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:43.444533 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-456718e0-f4e3-40f5-bf44-063f7a9bbbc1 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:43.445007 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-456718e0-f4e3-40f5-bf44-063f7a9bbbc1 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:43.629482 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-456718e0-f4e3-40f5-bf44-063f7a9bbbc1 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02142b6537394571912b52f061aeb082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fafe3a7726844018a6c308f8acdbb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:43.638054 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-456718e0-f4e3-40f5-bf44-063f7a9bbbc1 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] 10.222.0.33 "GET /compute/v2.1/servers/2c4200ea-e29d-4c22-bc72-174b478b18fe" status: 200 len: 1318 microversion: 2.1 time: 0.205734 Jul 28 05:34:43.638624 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 211/428] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:34:43 2022] GET /compute/v2.1/servers/2c4200ea-e29d-4c22-bc72-174b478b18fe => generated 1318 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:34:43.708308 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-a378825a-3a32-41d3-b189-9f49a6e4061a tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:43.709601 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-a378825a-3a32-41d3-b189-9f49a6e4061a tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:43.716511 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a378825a-3a32-41d3-b189-9f49a6e4061a tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:43.717780 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a378825a-3a32-41d3-b189-9f49a6e4061a tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:43.717780 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a378825a-3a32-41d3-b189-9f49a6e4061a tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:43.718396 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a378825a-3a32-41d3-b189-9f49a6e4061a tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:43.876747 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-a378825a-3a32-41d3-b189-9f49a6e4061a tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:43.888831 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-a378825a-3a32-41d3-b189-9f49a6e4061a tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:43.890546 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-a378825a-3a32-41d3-b189-9f49a6e4061a tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:43.891741 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-a378825a-3a32-41d3-b189-9f49a6e4061a tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1807 microversion: 2.20 time: 0.187464 Jul 28 05:34:43.892310 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 218/429] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:34:43 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1807 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:34:44.658657 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-7d9383c9-4534-4f55-9218-540de1900725 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:44.659268 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-7d9383c9-4534-4f55-9218-540de1900725 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] [instance: 2c4200ea-e29d-4c22-bc72-174b478b18fe] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:44.665993 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-7d9383c9-4534-4f55-9218-540de1900725 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:44.666444 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-7d9383c9-4534-4f55-9218-540de1900725 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:44.667202 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-7d9383c9-4534-4f55-9218-540de1900725 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:44.667638 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-7d9383c9-4534-4f55-9218-540de1900725 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:44.806444 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-7d9383c9-4534-4f55-9218-540de1900725 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02142b6537394571912b52f061aeb082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fafe3a7726844018a6c308f8acdbb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:44.814274 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-7d9383c9-4534-4f55-9218-540de1900725 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] 10.222.0.33 "GET /compute/v2.1/servers/2c4200ea-e29d-4c22-bc72-174b478b18fe" status: 200 len: 1318 microversion: 2.1 time: 0.159436 Jul 28 05:34:44.814847 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 212/430] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:34:44 2022] GET /compute/v2.1/servers/2c4200ea-e29d-4c22-bc72-174b478b18fe => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:34:44.916080 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-5992cf6f-d415-43c9-82a8-4c9df511f852 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:44.916690 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-5992cf6f-d415-43c9-82a8-4c9df511f852 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:44.923137 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5992cf6f-d415-43c9-82a8-4c9df511f852 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:44.923588 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5992cf6f-d415-43c9-82a8-4c9df511f852 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:44.924349 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5992cf6f-d415-43c9-82a8-4c9df511f852 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:44.924786 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5992cf6f-d415-43c9-82a8-4c9df511f852 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:45.060475 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-5992cf6f-d415-43c9-82a8-4c9df511f852 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:45.069018 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-5992cf6f-d415-43c9-82a8-4c9df511f852 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:45.070694 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-5992cf6f-d415-43c9-82a8-4c9df511f852 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:45.075897 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-5992cf6f-d415-43c9-82a8-4c9df511f852 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1807 microversion: 2.20 time: 0.160696 Jul 28 05:34:45.075897 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 219/431] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:34:44 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:34:45.758855 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-38abcb08-4ce4-4496-9dff-985b3198e60b tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "694e0bbd-d0e5-40df-96d2-516672ea911a"}} {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:34:45.761278 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-38abcb08-4ce4-4496-9dff-985b3198e60b tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:45.767942 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-38abcb08-4ce4-4496-9dff-985b3198e60b tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:45.768396 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-38abcb08-4ce4-4496-9dff-985b3198e60b tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:45.769161 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-38abcb08-4ce4-4496-9dff-985b3198e60b tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:45.769640 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-38abcb08-4ce4-4496-9dff-985b3198e60b tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:45.836038 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-d52a6f24-08c7-47f8-ac74-6333d46c2eda tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:45.837134 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-d52a6f24-08c7-47f8-ac74-6333d46c2eda tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] [instance: 2c4200ea-e29d-4c22-bc72-174b478b18fe] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:45.843302 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d52a6f24-08c7-47f8-ac74-6333d46c2eda tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:45.843747 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d52a6f24-08c7-47f8-ac74-6333d46c2eda tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:45.844501 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d52a6f24-08c7-47f8-ac74-6333d46c2eda tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:45.844927 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d52a6f24-08c7-47f8-ac74-6333d46c2eda tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:45.992826 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-d52a6f24-08c7-47f8-ac74-6333d46c2eda tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02142b6537394571912b52f061aeb082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fafe3a7726844018a6c308f8acdbb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:46.000279 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-d52a6f24-08c7-47f8-ac74-6333d46c2eda tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] 10.222.0.33 "GET /compute/v2.1/servers/2c4200ea-e29d-4c22-bc72-174b478b18fe" status: 200 len: 1318 microversion: 2.1 time: 0.168812 Jul 28 05:34:46.002326 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 220/432] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:34:45 2022] GET /compute/v2.1/servers/2c4200ea-e29d-4c22-bc72-174b478b18fe => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:34:46.096835 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-937c07cc-55b5-433e-9257-da84b5e27cd0 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:46.097449 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-937c07cc-55b5-433e-9257-da84b5e27cd0 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:46.104759 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-937c07cc-55b5-433e-9257-da84b5e27cd0 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:46.105338 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-937c07cc-55b5-433e-9257-da84b5e27cd0 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:46.106243 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-937c07cc-55b5-433e-9257-da84b5e27cd0 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:46.106821 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-937c07cc-55b5-433e-9257-da84b5e27cd0 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:46.252261 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-937c07cc-55b5-433e-9257-da84b5e27cd0 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:46.275290 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-937c07cc-55b5-433e-9257-da84b5e27cd0 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:46.278087 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-937c07cc-55b5-433e-9257-da84b5e27cd0 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:46.279438 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-937c07cc-55b5-433e-9257-da84b5e27cd0 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1807 microversion: 2.20 time: 0.187291 Jul 28 05:34:46.280220 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 221/433] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:34:46 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1807 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 05:34:46.547948 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-38abcb08-4ce4-4496-9dff-985b3198e60b tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "POST /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.793002 Jul 28 05:34:46.551550 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 213/434] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Jul 28 05:34:45 2022] POST /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9/os-volume_attachments => generated 194 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 05:34:47.021349 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-7f57900d-257e-4e51-aa4e-2cd83e842517 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:47.022011 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-7f57900d-257e-4e51-aa4e-2cd83e842517 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] [instance: 2c4200ea-e29d-4c22-bc72-174b478b18fe] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:47.028766 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7f57900d-257e-4e51-aa4e-2cd83e842517 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:47.029211 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7f57900d-257e-4e51-aa4e-2cd83e842517 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:47.030002 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7f57900d-257e-4e51-aa4e-2cd83e842517 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:47.030435 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7f57900d-257e-4e51-aa4e-2cd83e842517 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:47.192233 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-7f57900d-257e-4e51-aa4e-2cd83e842517 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02142b6537394571912b52f061aeb082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fafe3a7726844018a6c308f8acdbb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:47.199986 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-7f57900d-257e-4e51-aa4e-2cd83e842517 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] 10.222.0.33 "GET /compute/v2.1/servers/2c4200ea-e29d-4c22-bc72-174b478b18fe" status: 200 len: 1318 microversion: 2.1 time: 0.183205 Jul 28 05:34:47.200548 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 222/435] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:34:47 2022] GET /compute/v2.1/servers/2c4200ea-e29d-4c22-bc72-174b478b18fe => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:34:47.304648 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-60a3ad7f-a738-44fd-9768-d56dde78db20 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:47.305502 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-60a3ad7f-a738-44fd-9768-d56dde78db20 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:47.312717 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-60a3ad7f-a738-44fd-9768-d56dde78db20 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:47.313254 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-60a3ad7f-a738-44fd-9768-d56dde78db20 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:47.314129 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-60a3ad7f-a738-44fd-9768-d56dde78db20 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:47.314640 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-60a3ad7f-a738-44fd-9768-d56dde78db20 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:47.463538 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-60a3ad7f-a738-44fd-9768-d56dde78db20 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:47.472153 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-60a3ad7f-a738-44fd-9768-d56dde78db20 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:47.473783 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-60a3ad7f-a738-44fd-9768-d56dde78db20 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:47.475023 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-60a3ad7f-a738-44fd-9768-d56dde78db20 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1807 microversion: 2.20 time: 0.174623 Jul 28 05:34:47.475670 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 214/436] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:34:47 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:34:48.221516 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-505fc95d-2ad8-4295-bce5-4be165de4a51 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:48.222149 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-505fc95d-2ad8-4295-bce5-4be165de4a51 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] [instance: 2c4200ea-e29d-4c22-bc72-174b478b18fe] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:48.224212 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell0:SELECT=2 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:34:48.224880 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell0:SELECT=8 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:34:48.230246 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-505fc95d-2ad8-4295-bce5-4be165de4a51 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:48.230684 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-505fc95d-2ad8-4295-bce5-4be165de4a51 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:48.231445 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-505fc95d-2ad8-4295-bce5-4be165de4a51 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:48.231871 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-505fc95d-2ad8-4295-bce5-4be165de4a51 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:48.389225 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-505fc95d-2ad8-4295-bce5-4be165de4a51 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02142b6537394571912b52f061aeb082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fafe3a7726844018a6c308f8acdbb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:48.396782 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-505fc95d-2ad8-4295-bce5-4be165de4a51 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] 10.222.0.33 "GET /compute/v2.1/servers/2c4200ea-e29d-4c22-bc72-174b478b18fe" status: 200 len: 1318 microversion: 2.1 time: 0.179532 Jul 28 05:34:48.397460 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 223/437] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:34:48 2022] GET /compute/v2.1/servers/2c4200ea-e29d-4c22-bc72-174b478b18fe => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:34:48.500093 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-6d331249-ad91-42f8-805c-12045e493705 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:48.500696 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-6d331249-ad91-42f8-805c-12045e493705 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:48.507313 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-6d331249-ad91-42f8-805c-12045e493705 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:48.507750 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-6d331249-ad91-42f8-805c-12045e493705 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:48.508512 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-6d331249-ad91-42f8-805c-12045e493705 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:48.509210 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-6d331249-ad91-42f8-805c-12045e493705 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:48.650959 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-6d331249-ad91-42f8-805c-12045e493705 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:48.659590 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-6d331249-ad91-42f8-805c-12045e493705 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:48.661088 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-6d331249-ad91-42f8-805c-12045e493705 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:48.662350 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-6d331249-ad91-42f8-805c-12045e493705 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1807 microversion: 2.20 time: 0.166118 Jul 28 05:34:48.662950 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 215/438] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:34:48 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:34:49.120909 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-75f3dfb4-6b3b-495b-ba43-e81555ed2fd0 req-36103143-0428-4a8e-9b23-b73d1263b42a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c4200ea-e29d-4c22-bc72-174b478b18fe", "name": "network-vif-plugged", "status": "completed", "tag": "ad525c4e-158a-4aa3-9d2c-e4f773a1dd4b"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:34:49.130638 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-75f3dfb4-6b3b-495b-ba43-e81555ed2fd0 req-36103143-0428-4a8e-9b23-b73d1263b42a service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:49.130937 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-75f3dfb4-6b3b-495b-ba43-e81555ed2fd0 req-36103143-0428-4a8e-9b23-b73d1263b42a service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:49.142351 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-75f3dfb4-6b3b-495b-ba43-e81555ed2fd0 req-36103143-0428-4a8e-9b23-b73d1263b42a service nova] Creating event network-vif-plugged:ad525c4e-158a-4aa3-9d2c-e4f773a1dd4b for instance 2c4200ea-e29d-4c22-bc72-174b478b18fe on hv-cinder-79987 Jul 28 05:34:49.147471 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-75f3dfb4-6b3b-495b-ba43-e81555ed2fd0 req-36103143-0428-4a8e-9b23-b73d1263b42a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033442 Jul 28 05:34:49.151423 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 224/439] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:34:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:34:49.418404 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-8fb68558-8424-4218-825f-685f75c6b6c0 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:49.419020 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-8fb68558-8424-4218-825f-685f75c6b6c0 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] [instance: 2c4200ea-e29d-4c22-bc72-174b478b18fe] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:49.426101 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-8fb68558-8424-4218-825f-685f75c6b6c0 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:49.426554 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-8fb68558-8424-4218-825f-685f75c6b6c0 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:49.427386 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-8fb68558-8424-4218-825f-685f75c6b6c0 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:49.427833 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-8fb68558-8424-4218-825f-685f75c6b6c0 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:49.573038 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-8fb68558-8424-4218-825f-685f75c6b6c0 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02142b6537394571912b52f061aeb082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fafe3a7726844018a6c308f8acdbb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:49.581505 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-8fb68558-8424-4218-825f-685f75c6b6c0 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] 10.222.0.33 "GET /compute/v2.1/servers/2c4200ea-e29d-4c22-bc72-174b478b18fe" status: 200 len: 1318 microversion: 2.1 time: 0.167377 Jul 28 05:34:49.582084 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 216/440] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:34:49 2022] GET /compute/v2.1/servers/2c4200ea-e29d-4c22-bc72-174b478b18fe => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:34:49.687949 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-5983a428-ec29-46c3-a4fb-b7c24a597121 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:49.688649 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-5983a428-ec29-46c3-a4fb-b7c24a597121 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:49.695139 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5983a428-ec29-46c3-a4fb-b7c24a597121 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:49.695645 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5983a428-ec29-46c3-a4fb-b7c24a597121 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:49.697192 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5983a428-ec29-46c3-a4fb-b7c24a597121 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:49.697661 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5983a428-ec29-46c3-a4fb-b7c24a597121 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:49.831692 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-5983a428-ec29-46c3-a4fb-b7c24a597121 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:49.840800 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-5983a428-ec29-46c3-a4fb-b7c24a597121 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:49.842365 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-5983a428-ec29-46c3-a4fb-b7c24a597121 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:49.843537 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-5983a428-ec29-46c3-a4fb-b7c24a597121 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1807 microversion: 2.20 time: 0.160378 Jul 28 05:34:49.844158 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 225/441] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:34:49 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:34:50.602829 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-ef6bbbdc-ea6b-4c49-ab07-a650b4b5c830 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:50.603560 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-ef6bbbdc-ea6b-4c49-ab07-a650b4b5c830 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] [instance: 2c4200ea-e29d-4c22-bc72-174b478b18fe] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:50.610179 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-ef6bbbdc-ea6b-4c49-ab07-a650b4b5c830 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:50.610632 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-ef6bbbdc-ea6b-4c49-ab07-a650b4b5c830 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:50.611465 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-ef6bbbdc-ea6b-4c49-ab07-a650b4b5c830 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:50.611942 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-ef6bbbdc-ea6b-4c49-ab07-a650b4b5c830 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:50.745679 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-ef6bbbdc-ea6b-4c49-ab07-a650b4b5c830 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02142b6537394571912b52f061aeb082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fafe3a7726844018a6c308f8acdbb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:50.753303 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-ef6bbbdc-ea6b-4c49-ab07-a650b4b5c830 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] 10.222.0.33 "GET /compute/v2.1/servers/2c4200ea-e29d-4c22-bc72-174b478b18fe" status: 200 len: 1318 microversion: 2.1 time: 0.154398 Jul 28 05:34:50.753908 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 217/442] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:34:50 2022] GET /compute/v2.1/servers/2c4200ea-e29d-4c22-bc72-174b478b18fe => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:34:50.867652 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-65e24706-6374-493c-912b-940738750a2d tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:50.868283 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-65e24706-6374-493c-912b-940738750a2d tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:50.875220 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-65e24706-6374-493c-912b-940738750a2d tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:50.875671 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-65e24706-6374-493c-912b-940738750a2d tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:50.876448 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-65e24706-6374-493c-912b-940738750a2d tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:50.876888 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-65e24706-6374-493c-912b-940738750a2d tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:51.044868 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-65e24706-6374-493c-912b-940738750a2d tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:51.055926 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-65e24706-6374-493c-912b-940738750a2d tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:51.057428 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-65e24706-6374-493c-912b-940738750a2d tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:51.058772 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-65e24706-6374-493c-912b-940738750a2d tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1807 microversion: 2.20 time: 0.195238 Jul 28 05:34:51.060080 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 226/443] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:34:50 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1807 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:34:51.162741 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [req-b25cf4ce-0ac5-49ef-b8f6-9502834503cd req-070b254b-4b17-4409-ae2f-c41688794c86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57115a26-af82-499e-a831-4b4c40e60ac5", "name": "network-vif-plugged", "status": "completed", "tag": "968687ce-4c57-4729-84c6-548124c4123e"}]} {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:34:51.172625 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [req-b25cf4ce-0ac5-49ef-b8f6-9502834503cd req-070b254b-4b17-4409-ae2f-c41688794c86 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:51.173069 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [req-b25cf4ce-0ac5-49ef-b8f6-9502834503cd req-070b254b-4b17-4409-ae2f-c41688794c86 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:51.186883 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.compute.server_external_events [req-b25cf4ce-0ac5-49ef-b8f6-9502834503cd req-070b254b-4b17-4409-ae2f-c41688794c86 service nova] Creating event network-vif-plugged:968687ce-4c57-4729-84c6-548124c4123e for instance 57115a26-af82-499e-a831-4b4c40e60ac5 on hv-cinder-79987 Jul 28 05:34:51.191834 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [req-b25cf4ce-0ac5-49ef-b8f6-9502834503cd req-070b254b-4b17-4409-ae2f-c41688794c86 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032734 Jul 28 05:34:51.192433 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 218/444] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:34:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:34:51.775481 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-cd9cdf2f-1dea-4240-ba89-7a12acc9ca2c tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:51.776106 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-cd9cdf2f-1dea-4240-ba89-7a12acc9ca2c tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] [instance: 2c4200ea-e29d-4c22-bc72-174b478b18fe] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:51.782279 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-cd9cdf2f-1dea-4240-ba89-7a12acc9ca2c tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:51.782729 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-cd9cdf2f-1dea-4240-ba89-7a12acc9ca2c tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:51.783499 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-cd9cdf2f-1dea-4240-ba89-7a12acc9ca2c tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:51.783935 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-cd9cdf2f-1dea-4240-ba89-7a12acc9ca2c tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:51.931210 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-cd9cdf2f-1dea-4240-ba89-7a12acc9ca2c tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02142b6537394571912b52f061aeb082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fafe3a7726844018a6c308f8acdbb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:51.938665 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-cd9cdf2f-1dea-4240-ba89-7a12acc9ca2c tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] 10.222.0.33 "GET /compute/v2.1/servers/2c4200ea-e29d-4c22-bc72-174b478b18fe" status: 200 len: 1506 microversion: 2.1 time: 0.167547 Jul 28 05:34:51.939239 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 227/445] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:34:51 2022] GET /compute/v2.1/servers/2c4200ea-e29d-4c22-bc72-174b478b18fe => generated 1506 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:34:51.959962 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-006cdc18-d2e3-4e1a-9486-95e007067043 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9c1a71f2-3de4-4889-96c3-9f71a51c4753", "device": "/dev/sdb"}} {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:34:51.963173 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-006cdc18-d2e3-4e1a-9486-95e007067043 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] [instance: 2c4200ea-e29d-4c22-bc72-174b478b18fe] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:51.969379 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-006cdc18-d2e3-4e1a-9486-95e007067043 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:51.969867 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-006cdc18-d2e3-4e1a-9486-95e007067043 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:51.970664 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-006cdc18-d2e3-4e1a-9486-95e007067043 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:51.971106 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-006cdc18-d2e3-4e1a-9486-95e007067043 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:51.988573 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG dbcounter [-] [124483] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:34:52.082748 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-4a46dd88-e193-4dbb-8c8b-db29849aa7ca tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:52.083811 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-4a46dd88-e193-4dbb-8c8b-db29849aa7ca tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:52.092101 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4a46dd88-e193-4dbb-8c8b-db29849aa7ca tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:52.092632 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4a46dd88-e193-4dbb-8c8b-db29849aa7ca tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:52.093538 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4a46dd88-e193-4dbb-8c8b-db29849aa7ca tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:52.094045 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4a46dd88-e193-4dbb-8c8b-db29849aa7ca tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:52.230357 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-4a46dd88-e193-4dbb-8c8b-db29849aa7ca tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:52.239061 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-4a46dd88-e193-4dbb-8c8b-db29849aa7ca tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:52.240631 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-4a46dd88-e193-4dbb-8c8b-db29849aa7ca tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:52.241837 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-4a46dd88-e193-4dbb-8c8b-db29849aa7ca tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1807 microversion: 2.20 time: 0.163018 Jul 28 05:34:52.242415 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 228/446] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:34:52 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 05:34:52.869353 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-d7f370e0-db18-419e-9e33-9dcddaf9ad4a tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-428590888", "imageRef": "4f0ce061-6677-4c2a-9ee1-54a100f21462", "flavorRef": "452", "networks": [{"uuid": "12fe73f5-6d00-47cf-a14d-34af013f8456"}]}} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:34:52.902099 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-006cdc18-d2e3-4e1a-9486-95e007067043 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] 10.222.0.33 "POST /compute/v2.1/servers/2c4200ea-e29d-4c22-bc72-174b478b18fe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.946726 Jul 28 05:34:52.902707 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 219/447] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Jul 28 05:34:51 2022] POST /compute/v2.1/servers/2c4200ea-e29d-4c22-bc72-174b478b18fe/os-volume_attachments => generated 194 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:34:52.927738 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.network.neutron [None req-d7f370e0-db18-419e-9e33-9dcddaf9ad4a tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] validate_networks() for [('12fe73f5-6d00-47cf-a14d-34af013f8456', None, None, None, None, None)] {{(pid=124482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 05:34:53.266208 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-614c766e-270c-4ab7-be90-19645c4fecb1 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:53.267311 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-614c766e-270c-4ab7-be90-19645c4fecb1 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:53.275482 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-614c766e-270c-4ab7-be90-19645c4fecb1 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:53.276189 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-614c766e-270c-4ab7-be90-19645c4fecb1 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:53.277036 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-614c766e-270c-4ab7-be90-19645c4fecb1 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:53.277595 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-614c766e-270c-4ab7-be90-19645c4fecb1 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:53.278415 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-d7f370e0-db18-419e-9e33-9dcddaf9ad4a tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Flavor limits 0:0:0 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 05:34:53.278886 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-d7f370e0-db18-419e-9e33-9dcddaf9ad4a tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Image limits 0:0:0 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 05:34:53.279321 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-d7f370e0-db18-419e-9e33-9dcddaf9ad4a tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Flavor pref 0:0:0 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 05:34:53.279724 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-d7f370e0-db18-419e-9e33-9dcddaf9ad4a tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Image pref 0:0:0 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 05:34:53.280133 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-d7f370e0-db18-419e-9e33-9dcddaf9ad4a tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 05:34:53.289186 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d7f370e0-db18-419e-9e33-9dcddaf9ad4a tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:53.290399 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d7f370e0-db18-419e-9e33-9dcddaf9ad4a tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:53.291200 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d7f370e0-db18-419e-9e33-9dcddaf9ad4a tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:53.291689 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d7f370e0-db18-419e-9e33-9dcddaf9ad4a tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:53.308393 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.quota [None req-d7f370e0-db18-419e-9e33-9dcddaf9ad4a tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Getting quotas for project 6ce7104e69fe4e15b070558784aa40d6. Resources: {'ram', 'instances', 'cores'} {{(pid=124482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 05:34:53.312374 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.quota [None req-d7f370e0-db18-419e-9e33-9dcddaf9ad4a tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Getting quotas for user c3310483e0e64521999dfcafec143f0f and project 6ce7104e69fe4e15b070558784aa40d6. Resources: {'ram', 'instances', 'cores'} {{(pid=124482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 05:34:53.323614 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-d7f370e0-db18-419e-9e33-9dcddaf9ad4a tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Going to run 1 instances... {{(pid=124482) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 05:34:53.325916 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-d7f370e0-db18-419e-9e33-9dcddaf9ad4a tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] [instance: 76337f4b-add0-4221-8712-c9d29a9c459e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f0ce061-6677-4c2a-9ee1-54a100f21462',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 05:34:53.410557 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-614c766e-270c-4ab7-be90-19645c4fecb1 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:53.419986 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-614c766e-270c-4ab7-be90-19645c4fecb1 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:53.421552 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-614c766e-270c-4ab7-be90-19645c4fecb1 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:53.422823 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-614c766e-270c-4ab7-be90-19645c4fecb1 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1807 microversion: 2.20 time: 0.162095 Jul 28 05:34:53.423387 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 220/448] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:34:53 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 05:34:53.465357 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-d7f370e0-db18-419e-9e33-9dcddaf9ad4a tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.600430 Jul 28 05:34:53.466029 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 229/449] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Jul 28 05:34:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 05:34:53.477406 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-09396cdf-f0ec-4f1f-822d-f5a307683719 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:53.478166 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-09396cdf-f0ec-4f1f-822d-f5a307683719 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] [instance: 76337f4b-add0-4221-8712-c9d29a9c459e] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:53.529959 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-09396cdf-f0ec-4f1f-822d-f5a307683719 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3310483e0e64521999dfcafec143f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce7104e69fe4e15b070558784aa40d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:53.536582 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-09396cdf-f0ec-4f1f-822d-f5a307683719 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] 10.222.0.33 "GET /compute/v2.1/servers/76337f4b-add0-4221-8712-c9d29a9c459e" status: 200 len: 1213 microversion: 2.1 time: 0.063660 Jul 28 05:34:53.537152 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 221/450] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:34:53 2022] GET /compute/v2.1/servers/76337f4b-add0-4221-8712-c9d29a9c459e => generated 1213 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:34:54.446211 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-135481f7-9306-4494-b694-4330a27438d6 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:54.446830 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-135481f7-9306-4494-b694-4330a27438d6 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:54.453538 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-135481f7-9306-4494-b694-4330a27438d6 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:54.454011 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-135481f7-9306-4494-b694-4330a27438d6 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:54.454764 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-135481f7-9306-4494-b694-4330a27438d6 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:54.455203 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-135481f7-9306-4494-b694-4330a27438d6 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:54.558437 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-f1b21401-3347-4be2-a668-93e5ede9ac41 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:54.559017 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-f1b21401-3347-4be2-a668-93e5ede9ac41 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] [instance: 76337f4b-add0-4221-8712-c9d29a9c459e] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:54.565545 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-f1b21401-3347-4be2-a668-93e5ede9ac41 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:54.565995 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-f1b21401-3347-4be2-a668-93e5ede9ac41 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:54.566761 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-f1b21401-3347-4be2-a668-93e5ede9ac41 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:54.567200 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-f1b21401-3347-4be2-a668-93e5ede9ac41 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:54.590426 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-135481f7-9306-4494-b694-4330a27438d6 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:54.598620 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-135481f7-9306-4494-b694-4330a27438d6 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:54.600109 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-135481f7-9306-4494-b694-4330a27438d6 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:54.601320 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-135481f7-9306-4494-b694-4330a27438d6 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1807 microversion: 2.20 time: 0.159599 Jul 28 05:34:54.602425 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 230/451] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:34:54 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 05:34:54.633540 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-f1b21401-3347-4be2-a668-93e5ede9ac41 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3310483e0e64521999dfcafec143f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce7104e69fe4e15b070558784aa40d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:54.641104 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-f1b21401-3347-4be2-a668-93e5ede9ac41 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] 10.222.0.33 "GET /compute/v2.1/servers/76337f4b-add0-4221-8712-c9d29a9c459e" status: 200 len: 1217 microversion: 2.1 time: 0.087393 Jul 28 05:34:54.641775 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 222/452] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:34:54 2022] GET /compute/v2.1/servers/76337f4b-add0-4221-8712-c9d29a9c459e => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:34:55.624768 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-0c7c3065-3609-4dab-b49b-6cf565216dcd tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:55.625289 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-0c7c3065-3609-4dab-b49b-6cf565216dcd tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:55.631893 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-0c7c3065-3609-4dab-b49b-6cf565216dcd tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:55.632343 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-0c7c3065-3609-4dab-b49b-6cf565216dcd tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:55.633946 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-0c7c3065-3609-4dab-b49b-6cf565216dcd tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:55.634391 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-0c7c3065-3609-4dab-b49b-6cf565216dcd tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:55.649906 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell1:SELECT=100 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:34:55.661115 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-68d40742-a907-4cd8-8d88-0adb0fbcd711 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:55.663069 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-68d40742-a907-4cd8-8d88-0adb0fbcd711 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] [instance: 76337f4b-add0-4221-8712-c9d29a9c459e] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:55.668613 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-68d40742-a907-4cd8-8d88-0adb0fbcd711 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:55.669110 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-68d40742-a907-4cd8-8d88-0adb0fbcd711 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:55.669913 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-68d40742-a907-4cd8-8d88-0adb0fbcd711 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:55.670334 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-68d40742-a907-4cd8-8d88-0adb0fbcd711 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:55.744964 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.policy [None req-68d40742-a907-4cd8-8d88-0adb0fbcd711 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3310483e0e64521999dfcafec143f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce7104e69fe4e15b070558784aa40d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124483) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:55.753538 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-68d40742-a907-4cd8-8d88-0adb0fbcd711 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] 10.222.0.33 "GET /compute/v2.1/servers/76337f4b-add0-4221-8712-c9d29a9c459e" status: 200 len: 1265 microversion: 2.1 time: 0.096108 Jul 28 05:34:55.754125 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 223/453] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:34:55 2022] GET /compute/v2.1/servers/76337f4b-add0-4221-8712-c9d29a9c459e => generated 1265 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:34:55.790509 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-0c7c3065-3609-4dab-b49b-6cf565216dcd tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:55.800159 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-0c7c3065-3609-4dab-b49b-6cf565216dcd tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:55.805981 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-0c7c3065-3609-4dab-b49b-6cf565216dcd tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:55.805981 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-0c7c3065-3609-4dab-b49b-6cf565216dcd tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1794 microversion: 2.20 time: 0.182184 Jul 28 05:34:55.805981 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 231/454] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:34:55 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1794 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:34:56.220831 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-9c246290-baa0-464d-8968-01b0a21b45c9 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:34:56.223305 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-9c246290-baa0-464d-8968-01b0a21b45c9 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:56.230058 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-9c246290-baa0-464d-8968-01b0a21b45c9 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:56.230621 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-9c246290-baa0-464d-8968-01b0a21b45c9 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:56.231387 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-9c246290-baa0-464d-8968-01b0a21b45c9 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:56.231820 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-9c246290-baa0-464d-8968-01b0a21b45c9 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:56.254067 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.objects.instance [None req-9c246290-baa0-464d-8968-01b0a21b45c9 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lazy-loading 'flavor' on Instance uuid 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 {{(pid=124483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 05:34:56.542593 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: INFO nova.api.openstack.requestlog [None req-9c246290-baa0-464d-8968-01b0a21b45c9 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "POST /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9/action" status: 200 len: 32 microversion: 2.1 time: 0.325649 Jul 28 05:34:56.543204 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: [pid: 124483|app: 0|req: 224/455] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Jul 28 05:34:56 2022] POST /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9/action => generated 32 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 05:34:56.553749 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-af39d701-91df-4fc6-9ee7-9d3143b7cde8 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:56.554489 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-af39d701-91df-4fc6-9ee7-9d3143b7cde8 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:56.560932 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-af39d701-91df-4fc6-9ee7-9d3143b7cde8 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:56.561462 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-af39d701-91df-4fc6-9ee7-9d3143b7cde8 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:56.562329 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-af39d701-91df-4fc6-9ee7-9d3143b7cde8 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:56.562976 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-af39d701-91df-4fc6-9ee7-9d3143b7cde8 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:56.778403 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-af39d701-91df-4fc6-9ee7-9d3143b7cde8 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:56.780080 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.api.openstack.wsgi [None req-741bb842-0b15-4417-8496-50e84138d566 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Calling method '>' {{(pid=124483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:56.781421 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG nova.compute.api [None req-741bb842-0b15-4417-8496-50e84138d566 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] [instance: 76337f4b-add0-4221-8712-c9d29a9c459e] Fetching instance by UUID {{(pid=124483) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:56.787937 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-af39d701-91df-4fc6-9ee7-9d3143b7cde8 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9" status: 200 len: 1735 microversion: 2.1 time: 0.239163 Jul 28 05:34:56.788451 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-741bb842-0b15-4417-8496-50e84138d566 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:56.788770 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 232/456] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:34:56 2022] GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 => generated 1735 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:34:56.801007 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: DEBUG oslo_concurrency.lockutils [None req-741bb842-0b15-4417-8496-50e84138d566 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:56.817816 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: Traceback (most recent call last): Jul 28 05:34:56.817977 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Jul 28 05:34:56.817977 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: timer() Jul 28 05:34:56.817977 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Jul 28 05:34:56.817977 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: cb(*args, **kw) Jul 28 05:34:56.817977 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: File "/usr/local/lib/python3.8/dist-packages/eventlet/semaphore.py", line 147, in _do_acquire Jul 28 05:34:56.817977 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: waiter.switch() Jul 28 05:34:56.817977 dv-cinder-799871-48-iscsi devstack@n-api.service[124483]: greenlet.error: cannot switch to a different thread Jul 28 05:34:57.679047 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-c0a5caee-90f7-49db-81ca-0685b56d15f6 req-ff350243-9a79-4d16-b72b-0e886b3cd0e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76337f4b-add0-4221-8712-c9d29a9c459e", "tag": "8ebaf053-9d65-45e3-b15e-dd2dc4a17cce"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:34:57.689399 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-c0a5caee-90f7-49db-81ca-0685b56d15f6 req-ff350243-9a79-4d16-b72b-0e886b3cd0e3 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:57.690685 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-c0a5caee-90f7-49db-81ca-0685b56d15f6 req-ff350243-9a79-4d16-b72b-0e886b3cd0e3 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:57.702622 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-c0a5caee-90f7-49db-81ca-0685b56d15f6 req-ff350243-9a79-4d16-b72b-0e886b3cd0e3 service nova] Creating event network-changed:8ebaf053-9d65-45e3-b15e-dd2dc4a17cce for instance 76337f4b-add0-4221-8712-c9d29a9c459e on hv-cinder-79987 Jul 28 05:34:57.707535 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-c0a5caee-90f7-49db-81ca-0685b56d15f6 req-ff350243-9a79-4d16-b72b-0e886b3cd0e3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032446 Jul 28 05:34:57.708137 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 233/457] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:34:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 05:34:57.809794 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-45824c02-e505-46eb-a1af-7bbda35801cd tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:57.810492 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-45824c02-e505-46eb-a1af-7bbda35801cd tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:57.816631 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-45824c02-e505-46eb-a1af-7bbda35801cd tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:57.817069 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-45824c02-e505-46eb-a1af-7bbda35801cd tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:57.817844 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-45824c02-e505-46eb-a1af-7bbda35801cd tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:57.818276 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-45824c02-e505-46eb-a1af-7bbda35801cd tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:57.952731 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-45824c02-e505-46eb-a1af-7bbda35801cd tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:57.960880 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-45824c02-e505-46eb-a1af-7bbda35801cd tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9" status: 200 len: 1735 microversion: 2.1 time: 0.155438 Jul 28 05:34:57.961450 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 234/458] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:34:57 2022] GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:34:58.983361 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-6b7f8d70-e739-4206-a97e-526728d13bd4 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:34:58.984023 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-6b7f8d70-e739-4206-a97e-526728d13bd4 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:34:58.990367 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-6b7f8d70-e739-4206-a97e-526728d13bd4 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:58.990810 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-6b7f8d70-e739-4206-a97e-526728d13bd4 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:58.991668 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-6b7f8d70-e739-4206-a97e-526728d13bd4 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:34:58.992069 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-6b7f8d70-e739-4206-a97e-526728d13bd4 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:34:59.183613 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-6b7f8d70-e739-4206-a97e-526728d13bd4 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:34:59.191568 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-6b7f8d70-e739-4206-a97e-526728d13bd4 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9" status: 200 len: 1735 microversion: 2.1 time: 0.212218 Jul 28 05:34:59.192144 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 235/459] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:34:58 2022] GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 => generated 1735 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:35:00.213480 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-7fa56036-1273-40cd-9550-968cf9e49351 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:00.214111 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-7fa56036-1273-40cd-9550-968cf9e49351 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:00.220483 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7fa56036-1273-40cd-9550-968cf9e49351 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:00.220928 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7fa56036-1273-40cd-9550-968cf9e49351 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:00.221718 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7fa56036-1273-40cd-9550-968cf9e49351 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:00.222151 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7fa56036-1273-40cd-9550-968cf9e49351 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:00.354759 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-7fa56036-1273-40cd-9550-968cf9e49351 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:00.362717 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-7fa56036-1273-40cd-9550-968cf9e49351 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9" status: 200 len: 1735 microversion: 2.1 time: 0.153245 Jul 28 05:35:00.363299 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 236/460] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:00 2022] GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:35:01.384135 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-ff56aa96-7254-4767-b6db-46703f9c5ee2 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:01.385415 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-ff56aa96-7254-4767-b6db-46703f9c5ee2 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:01.387921 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=6 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:35:01.392681 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ff56aa96-7254-4767-b6db-46703f9c5ee2 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:01.393122 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ff56aa96-7254-4767-b6db-46703f9c5ee2 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:01.393907 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ff56aa96-7254-4767-b6db-46703f9c5ee2 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:01.394341 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ff56aa96-7254-4767-b6db-46703f9c5ee2 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:01.534510 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-ff56aa96-7254-4767-b6db-46703f9c5ee2 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:01.542864 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-ff56aa96-7254-4767-b6db-46703f9c5ee2 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9" status: 200 len: 1735 microversion: 2.1 time: 0.162544 Jul 28 05:35:01.543444 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 237/461] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:01 2022] GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:35:02.468612 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-aeaddcbd-d872-41c9-927a-2136532e0419 req-bb64b5ec-5295-4997-958f-b7135895a0ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76337f4b-add0-4221-8712-c9d29a9c459e", "name": "network-vif-plugged", "status": "completed", "tag": "8ebaf053-9d65-45e3-b15e-dd2dc4a17cce"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:35:02.479311 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-aeaddcbd-d872-41c9-927a-2136532e0419 req-bb64b5ec-5295-4997-958f-b7135895a0ec service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:02.479764 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-aeaddcbd-d872-41c9-927a-2136532e0419 req-bb64b5ec-5295-4997-958f-b7135895a0ec service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:02.490385 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-aeaddcbd-d872-41c9-927a-2136532e0419 req-bb64b5ec-5295-4997-958f-b7135895a0ec service nova] Creating event network-vif-plugged:8ebaf053-9d65-45e3-b15e-dd2dc4a17cce for instance 76337f4b-add0-4221-8712-c9d29a9c459e on hv-cinder-79987 Jul 28 05:35:02.494986 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-aeaddcbd-d872-41c9-927a-2136532e0419 req-bb64b5ec-5295-4997-958f-b7135895a0ec service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030153 Jul 28 05:35:02.495561 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 238/462] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:35:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 05:35:02.571366 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-833572e2-33e4-4f21-a818-38a98d71446a tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:02.571366 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-833572e2-33e4-4f21-a818-38a98d71446a tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:02.576081 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-833572e2-33e4-4f21-a818-38a98d71446a tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:02.576528 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-833572e2-33e4-4f21-a818-38a98d71446a tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:02.577297 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-833572e2-33e4-4f21-a818-38a98d71446a tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:02.577752 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-833572e2-33e4-4f21-a818-38a98d71446a tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:02.711334 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-833572e2-33e4-4f21-a818-38a98d71446a tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:02.720753 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-833572e2-33e4-4f21-a818-38a98d71446a tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9" status: 200 len: 1735 microversion: 2.1 time: 0.156822 Jul 28 05:35:02.721334 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 239/463] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:02 2022] GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:35:03.742178 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-50fe2862-62b3-44e9-b8cc-5d86e841edb9 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:03.742789 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-50fe2862-62b3-44e9-b8cc-5d86e841edb9 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:03.745184 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell0:SELECT=2 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:35:03.746109 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell0:SELECT=6 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:35:03.750903 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-50fe2862-62b3-44e9-b8cc-5d86e841edb9 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:03.751352 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-50fe2862-62b3-44e9-b8cc-5d86e841edb9 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:03.752114 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-50fe2862-62b3-44e9-b8cc-5d86e841edb9 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:03.752622 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-50fe2862-62b3-44e9-b8cc-5d86e841edb9 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:03.884867 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-50fe2862-62b3-44e9-b8cc-5d86e841edb9 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:03.893013 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-50fe2862-62b3-44e9-b8cc-5d86e841edb9 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9" status: 200 len: 1735 microversion: 2.1 time: 0.154777 Jul 28 05:35:03.893606 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 240/464] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:03 2022] GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:35:04.915495 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-4e438c66-b1bc-492a-bbc2-2a7a389b9755 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:04.916656 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-4e438c66-b1bc-492a-bbc2-2a7a389b9755 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:04.923257 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4e438c66-b1bc-492a-bbc2-2a7a389b9755 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:04.923705 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4e438c66-b1bc-492a-bbc2-2a7a389b9755 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:04.924467 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4e438c66-b1bc-492a-bbc2-2a7a389b9755 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:04.924906 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4e438c66-b1bc-492a-bbc2-2a7a389b9755 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:05.051888 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-4e438c66-b1bc-492a-bbc2-2a7a389b9755 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:05.061822 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-4e438c66-b1bc-492a-bbc2-2a7a389b9755 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9" status: 200 len: 1735 microversion: 2.1 time: 0.149958 Jul 28 05:35:05.061995 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 241/465] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:04 2022] GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:35:06.082305 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-31a97867-77c2-4c29-88f3-50993bfd33d9 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:06.082969 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-31a97867-77c2-4c29-88f3-50993bfd33d9 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:06.089185 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-31a97867-77c2-4c29-88f3-50993bfd33d9 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:06.089668 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-31a97867-77c2-4c29-88f3-50993bfd33d9 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:06.090471 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-31a97867-77c2-4c29-88f3-50993bfd33d9 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:06.090910 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-31a97867-77c2-4c29-88f3-50993bfd33d9 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:06.219451 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-31a97867-77c2-4c29-88f3-50993bfd33d9 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:06.227342 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-31a97867-77c2-4c29-88f3-50993bfd33d9 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9" status: 200 len: 1735 microversion: 2.1 time: 0.148869 Jul 28 05:35:06.227911 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 242/466] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:06 2022] GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:35:07.248254 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-81274928-cb4d-4172-a281-efc5966610c7 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:07.248869 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-81274928-cb4d-4172-a281-efc5966610c7 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:07.255379 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-81274928-cb4d-4172-a281-efc5966610c7 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:07.255827 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-81274928-cb4d-4172-a281-efc5966610c7 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:07.256591 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-81274928-cb4d-4172-a281-efc5966610c7 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:07.257028 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-81274928-cb4d-4172-a281-efc5966610c7 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:07.388414 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-81274928-cb4d-4172-a281-efc5966610c7 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:07.396596 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-81274928-cb4d-4172-a281-efc5966610c7 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9" status: 200 len: 1735 microversion: 2.1 time: 0.152231 Jul 28 05:35:07.397167 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 243/467] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:07 2022] GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:35:07.571227 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-d1c5f335-de2b-45cc-bd1d-afd06a19f945 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:07.571730 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-d1c5f335-de2b-45cc-bd1d-afd06a19f945 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:07.579318 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d1c5f335-de2b-45cc-bd1d-afd06a19f945 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:07.579709 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d1c5f335-de2b-45cc-bd1d-afd06a19f945 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:07.580462 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d1c5f335-de2b-45cc-bd1d-afd06a19f945 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:07.580890 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d1c5f335-de2b-45cc-bd1d-afd06a19f945 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:07.708999 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.objects.instance [None req-d1c5f335-de2b-45cc-bd1d-afd06a19f945 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lazy-loading 'services' on Instance uuid 0539d466-3f2e-414a-8563-45ad82a3f268 {{(pid=124482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 05:35:07.988527 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-d1c5f335-de2b-45cc-bd1d-afd06a19f945 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268/os-volume_attachments/fc3b9eea-65d4-4d24-b3db-51644c1ebddd" status: 202 len: 0 microversion: 2.1 time: 0.420985 Jul 28 05:35:07.989184 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 244/468] 10.222.0.33 () {58 vars in 1416 bytes} [Thu Jul 28 05:35:07 2022] DELETE /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268/os-volume_attachments/fc3b9eea-65d4-4d24-b3db-51644c1ebddd => generated 0 bytes in 423 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 05:35:08.181112 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-d6782f3d-e31a-48fa-a265-3cc13eb3c3de tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:08.181887 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-d6782f3d-e31a-48fa-a265-3cc13eb3c3de tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: d2380b3f-75da-4c71-9bf5-bc1b1cb0611b] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:08.188198 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d6782f3d-e31a-48fa-a265-3cc13eb3c3de tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:08.188655 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d6782f3d-e31a-48fa-a265-3cc13eb3c3de tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:08.189415 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d6782f3d-e31a-48fa-a265-3cc13eb3c3de tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:08.190209 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d6782f3d-e31a-48fa-a265-3cc13eb3c3de tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:08.214361 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-d6782f3d-e31a-48fa-a265-3cc13eb3c3de tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/d2380b3f-75da-4c71-9bf5-bc1b1cb0611b/ips" status: 200 len: 150 microversion: 2.1 time: 0.037319 Jul 28 05:35:08.215109 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 245/469] 10.222.0.33 () {58 vars in 1248 bytes} [Thu Jul 28 05:35:08 2022] GET /compute/v2.1/servers/d2380b3f-75da-4c71-9bf5-bc1b1cb0611b/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:35:08.226348 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-4d18c272-24e0-4661-a3a2-ee0da03af477 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "656850b6-af39-404a-921a-f1cf74d99571"}} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:35:08.229401 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-4d18c272-24e0-4661-a3a2-ee0da03af477 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: d2380b3f-75da-4c71-9bf5-bc1b1cb0611b] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:08.235471 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4d18c272-24e0-4661-a3a2-ee0da03af477 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:08.238248 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4d18c272-24e0-4661-a3a2-ee0da03af477 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:08.238248 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4d18c272-24e0-4661-a3a2-ee0da03af477 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:08.238248 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4d18c272-24e0-4661-a3a2-ee0da03af477 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:08.318567 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.wsgi [None req-4d18c272-24e0-4661-a3a2-ee0da03af477 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] HTTP exception thrown: Invalid volume: volume 656850b6-af39-404a-921a-f1cf74d99571 is already attached to instances: f769843b-cb4a-4599-bf54-49d579601a8a Jul 28 05:35:08.320289 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-4d18c272-24e0-4661-a3a2-ee0da03af477 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Request method failure captured: Jul 28 05:35:08.320289 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: request: POST /compute/v2.1/servers/d2380b3f-75da-4c71-9bf5-bc1b1cb0611b/os-volume_attachments HTTP/1.1 Jul 28 05:35:08.320289 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept: application/json Jul 28 05:35:08.320289 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept-Encoding: identity Jul 28 05:35:08.320289 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Connection: close Jul 28 05:35:08.320289 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Length: 74 Jul 28 05:35:08.320289 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Type: application/json Jul 28 05:35:08.320289 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Host: 10.222.0.33 Jul 28 05:35:08.320289 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Openstack-System-Scope: None Jul 28 05:35:08.320289 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: User-Agent: python-urllib3/1.26.10 Jul 28 05:35:08.320289 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Auth-Token: gAAAAABi4h9D_G9i011T28yIc-ZNvejV_UpI0QoKlXE0FGZ91QFBkrT7qoFtXVHh-pu6aHMGmM56LTiBsS724USe_vuB1sVPXPQos6zopSWxHNIiTv0vnR9zJg55cl6dG7-t6mrt4b6a18Xfa5nEVVolwB-FkmudbFUJziZU1gufozNL3J-fAhg Jul 28 05:35:08.320289 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Id: None Jul 28 05:35:08.320289 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Name: None Jul 28 05:35:08.320289 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Identity-Status: Confirmed Jul 28 05:35:08.320289 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Is-Admin-Project: True Jul 28 05:35:08.320289 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Id: default Jul 28 05:35:08.320289 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Name: Default Jul 28 05:35:08.320289 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Id: ba0b7f7639504a25a73c94335d62b98f Jul 28 05:35:08.320289 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Name: tempest-AttachVolumeNegativeTest-1557602675 Jul 28 05:35:08.320289 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Role: member,reader Jul 28 05:35:08.320289 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Roles: member,reader Jul 28 05:35:08.321839 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ba0b7f7639504a25a73c94335d62b98f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ba0b7f7639504a25a73c94335d62b98f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ba0b7f7639504a25a73c94335d62b98f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ba0b7f7639504a25a73c94335d62b98f"}]}] Jul 28 05:35:08.321839 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant: tempest-AttachVolumeNegativeTest-1557602675 Jul 28 05:35:08.321839 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Id: ba0b7f7639504a25a73c94335d62b98f Jul 28 05:35:08.321839 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1557602675 Jul 28 05:35:08.321839 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User: tempest-AttachVolumeNegativeTest-1557602675-project Jul 28 05:35:08.321839 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Id: default Jul 28 05:35:08.321839 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Name: Default Jul 28 05:35:08.321839 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Id: 0002ebbc629b4dafb109dc94450fe1d8 Jul 28 05:35:08.321839 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Name: tempest-AttachVolumeNegativeTest-1557602675-project Jul 28 05:35:08.321839 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Jul 28 05:35:08.321839 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: {"volumeAttachment": {"volumeId": "656850b6-af39-404a-921a-f1cf74d99571"}} Jul 28 05:35:08.321839 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: method: > Jul 28 05:35:08.322817 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: exception: Invalid volume: volume 656850b6-af39-404a-921a-f1cf74d99571 is already attached to instances: f769843b-cb4a-4599-bf54-49d579601a8a Jul 28 05:35:08.322817 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: action_args: {'server_id': 'd2380b3f-75da-4c71-9bf5-bc1b1cb0611b', 'body': {'volumeAttachment': {'volumeId': '656850b6-af39-404a-921a-f1cf74d99571'}}} Jul 28 05:35:08.322817 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 05:35:08.322817 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:35:08.322817 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 28 05:35:08.322817 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 28 05:35:08.322817 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 05:35:08.322817 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 05:35:08.322817 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 28 05:35:08.322817 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 05:35:08.322817 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5067, in attach_volume Jul 28 05:35:08.322817 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 28 05:35:08.322817 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4907, in _check_volume_already_attached Jul 28 05:35:08.322817 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 28 05:35:08.322817 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 656850b6-af39-404a-921a-f1cf74d99571 is already attached to instances: f769843b-cb4a-4599-bf54-49d579601a8a Jul 28 05:35:08.322817 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:35:08.322817 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:35:08.322817 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:35:08.322817 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:35:08.324070 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:35:08.324070 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:35:08.324070 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 05:35:08.324070 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 05:35:08.324070 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 05:35:08.324070 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:35:08.324070 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 05:35:08.324070 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 05:35:08.324070 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 05:35:08.324070 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 05:35:08.324070 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 05:35:08.324070 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 05:35:08.324070 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 28 05:35:08.324070 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 28 05:35:08.324070 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 656850b6-af39-404a-921a-f1cf74d99571 is already attached to instances: f769843b-cb4a-4599-bf54-49d579601a8a Jul 28 05:35:08.324070 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:35:08.324070 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:35:08.324070 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:35:08.324070 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:35:08.324070 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:35:08.325299 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:35:08.325299 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 05:35:08.325299 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 05:35:08.325299 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 656850b6-af39-404a-921a-f1cf74d99571 is already attached to instances: f769843b-cb4a-4599-bf54-49d579601a8a Jul 28 05:35:08.325299 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:35:08.325299 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-4d18c272-24e0-4661-a3a2-ee0da03af477 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Returning 400 to user: Invalid volume: volume 656850b6-af39-404a-921a-f1cf74d99571 is already attached to instances: f769843b-cb4a-4599-bf54-49d579601a8a {{(pid=124482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 05:35:08.325299 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-4d18c272-24e0-4661-a3a2-ee0da03af477 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "POST /compute/v2.1/servers/d2380b3f-75da-4c71-9bf5-bc1b1cb0611b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099309 Jul 28 05:35:08.325299 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 246/470] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Jul 28 05:35:08 2022] POST /compute/v2.1/servers/d2380b3f-75da-4c71-9bf5-bc1b1cb0611b/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 28 05:35:08.330667 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-ee0c4cc8-8bf7-4cd4-8af1-f4c480abe5de tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:08.331187 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-ee0c4cc8-8bf7-4cd4-8af1-f4c480abe5de tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: d2380b3f-75da-4c71-9bf5-bc1b1cb0611b] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:08.337491 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ee0c4cc8-8bf7-4cd4-8af1-f4c480abe5de tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:08.338648 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ee0c4cc8-8bf7-4cd4-8af1-f4c480abe5de tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:08.339415 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ee0c4cc8-8bf7-4cd4-8af1-f4c480abe5de tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:08.339857 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ee0c4cc8-8bf7-4cd4-8af1-f4c480abe5de tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:08.364725 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-ee0c4cc8-8bf7-4cd4-8af1-f4c480abe5de tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: d2380b3f-75da-4c71-9bf5-bc1b1cb0611b] Going to try to terminate instance {{(pid=124482) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 05:35:08.497038 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:35:08.750070 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-ee0c4cc8-8bf7-4cd4-8af1-f4c480abe5de tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d2380b3f-75da-4c71-9bf5-bc1b1cb0611b" status: 204 len: 0 microversion: 2.1 time: 0.422622 Jul 28 05:35:08.750593 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 247/471] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Jul 28 05:35:08 2022] DELETE /compute/v2.1/servers/d2380b3f-75da-4c71-9bf5-bc1b1cb0611b => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 05:35:08.755768 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-40f01568-d968-4dc9-a998-de4a6900e90c tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:08.756462 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-40f01568-d968-4dc9-a998-de4a6900e90c tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:08.763612 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-40f01568-d968-4dc9-a998-de4a6900e90c tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:08.764063 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-40f01568-d968-4dc9-a998-de4a6900e90c tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:08.764830 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-40f01568-d968-4dc9-a998-de4a6900e90c tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:08.765305 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-40f01568-d968-4dc9-a998-de4a6900e90c tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:08.896070 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-40f01568-d968-4dc9-a998-de4a6900e90c tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:08.904670 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-40f01568-d968-4dc9-a998-de4a6900e90c tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9" status: 200 len: 1735 microversion: 2.1 time: 0.152977 Jul 28 05:35:08.910950 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 248/472] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:08 2022] GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:35:08.910950 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-3f6be2ea-dd5e-4f72-8bcb-6f7948dfdf81 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:08.910950 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-3f6be2ea-dd5e-4f72-8bcb-6f7948dfdf81 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: d2380b3f-75da-4c71-9bf5-bc1b1cb0611b] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:08.915927 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3f6be2ea-dd5e-4f72-8bcb-6f7948dfdf81 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:08.916373 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3f6be2ea-dd5e-4f72-8bcb-6f7948dfdf81 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:08.917125 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3f6be2ea-dd5e-4f72-8bcb-6f7948dfdf81 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:08.917591 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3f6be2ea-dd5e-4f72-8bcb-6f7948dfdf81 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:09.047746 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-3f6be2ea-dd5e-4f72-8bcb-6f7948dfdf81 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:09.055115 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-3f6be2ea-dd5e-4f72-8bcb-6f7948dfdf81 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/d2380b3f-75da-4c71-9bf5-bc1b1cb0611b" status: 200 len: 1681 microversion: 2.1 time: 0.148906 Jul 28 05:35:09.055723 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 249/473] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:08 2022] GET /compute/v2.1/servers/d2380b3f-75da-4c71-9bf5-bc1b1cb0611b => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:35:09.926360 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-9e01d334-d416-4ae8-8130-a9661f21673b tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:09.927017 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-9e01d334-d416-4ae8-8130-a9661f21673b tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:09.933392 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9e01d334-d416-4ae8-8130-a9661f21673b tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:09.933871 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9e01d334-d416-4ae8-8130-a9661f21673b tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:09.934632 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9e01d334-d416-4ae8-8130-a9661f21673b tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:09.935067 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9e01d334-d416-4ae8-8130-a9661f21673b tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:10.061782 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-9e01d334-d416-4ae8-8130-a9661f21673b tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:10.079496 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-9e01d334-d416-4ae8-8130-a9661f21673b tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9" status: 200 len: 1735 microversion: 2.1 time: 0.147137 Jul 28 05:35:10.079496 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 250/474] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:09 2022] GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:35:10.079496 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-5fb84b03-b5a1-457b-8e41-1659265d5ef7 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:10.079496 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-5fb84b03-b5a1-457b-8e41-1659265d5ef7 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: d2380b3f-75da-4c71-9bf5-bc1b1cb0611b] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:10.083670 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5fb84b03-b5a1-457b-8e41-1659265d5ef7 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:10.084224 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5fb84b03-b5a1-457b-8e41-1659265d5ef7 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:10.084974 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5fb84b03-b5a1-457b-8e41-1659265d5ef7 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:10.085553 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5fb84b03-b5a1-457b-8e41-1659265d5ef7 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:10.217774 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-5fb84b03-b5a1-457b-8e41-1659265d5ef7 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:10.225177 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-5fb84b03-b5a1-457b-8e41-1659265d5ef7 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/d2380b3f-75da-4c71-9bf5-bc1b1cb0611b" status: 200 len: 1681 microversion: 2.1 time: 0.151615 Jul 28 05:35:10.225771 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 251/475] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:10 2022] GET /compute/v2.1/servers/d2380b3f-75da-4c71-9bf5-bc1b1cb0611b => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:35:11.091430 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-df1030a3-df1e-4138-bb9c-2be044b43b9e tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:11.092079 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-df1030a3-df1e-4138-bb9c-2be044b43b9e tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:11.098471 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-df1030a3-df1e-4138-bb9c-2be044b43b9e tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:11.098922 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-df1030a3-df1e-4138-bb9c-2be044b43b9e tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:11.099678 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-df1030a3-df1e-4138-bb9c-2be044b43b9e tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:11.100114 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-df1030a3-df1e-4138-bb9c-2be044b43b9e tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:11.232294 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-df1030a3-df1e-4138-bb9c-2be044b43b9e tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:11.240268 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-df1030a3-df1e-4138-bb9c-2be044b43b9e tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9" status: 200 len: 1735 microversion: 2.1 time: 0.152803 Jul 28 05:35:11.240836 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 252/476] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:11 2022] GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:35:11.245702 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-465dea7e-9cce-4caf-8170-3bafa6d094c8 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:11.246310 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-465dea7e-9cce-4caf-8170-3bafa6d094c8 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: d2380b3f-75da-4c71-9bf5-bc1b1cb0611b] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:11.253040 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-465dea7e-9cce-4caf-8170-3bafa6d094c8 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:11.253516 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-465dea7e-9cce-4caf-8170-3bafa6d094c8 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:11.254278 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-465dea7e-9cce-4caf-8170-3bafa6d094c8 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:11.254714 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-465dea7e-9cce-4caf-8170-3bafa6d094c8 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:11.382247 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-465dea7e-9cce-4caf-8170-3bafa6d094c8 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:11.389742 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-465dea7e-9cce-4caf-8170-3bafa6d094c8 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/d2380b3f-75da-4c71-9bf5-bc1b1cb0611b" status: 200 len: 1681 microversion: 2.1 time: 0.147489 Jul 28 05:35:11.390307 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 253/477] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:11 2022] GET /compute/v2.1/servers/d2380b3f-75da-4c71-9bf5-bc1b1cb0611b => generated 1681 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:35:12.264121 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-e8a3850e-0739-4171-b2d9-ca365fa02128 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:12.264778 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-e8a3850e-0739-4171-b2d9-ca365fa02128 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:12.272067 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e8a3850e-0739-4171-b2d9-ca365fa02128 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:12.272513 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e8a3850e-0739-4171-b2d9-ca365fa02128 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:12.273280 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e8a3850e-0739-4171-b2d9-ca365fa02128 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:12.273756 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e8a3850e-0739-4171-b2d9-ca365fa02128 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:12.403739 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-e8a3850e-0739-4171-b2d9-ca365fa02128 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:12.412048 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-e8a3850e-0739-4171-b2d9-ca365fa02128 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9" status: 200 len: 1735 microversion: 2.1 time: 0.153857 Jul 28 05:35:12.416800 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 254/478] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:12 2022] GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:35:12.417882 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-bdbe1dc0-ba65-41d3-b0aa-4bbb6d4cd95d tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:12.418480 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-bdbe1dc0-ba65-41d3-b0aa-4bbb6d4cd95d tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: d2380b3f-75da-4c71-9bf5-bc1b1cb0611b] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:12.424281 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-bdbe1dc0-ba65-41d3-b0aa-4bbb6d4cd95d tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:12.424814 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-bdbe1dc0-ba65-41d3-b0aa-4bbb6d4cd95d tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:12.425617 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-bdbe1dc0-ba65-41d3-b0aa-4bbb6d4cd95d tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:12.426059 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-bdbe1dc0-ba65-41d3-b0aa-4bbb6d4cd95d tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:12.556919 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-bdbe1dc0-ba65-41d3-b0aa-4bbb6d4cd95d tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:12.564921 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-bdbe1dc0-ba65-41d3-b0aa-4bbb6d4cd95d tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/d2380b3f-75da-4c71-9bf5-bc1b1cb0611b" status: 200 len: 1681 microversion: 2.1 time: 0.151170 Jul 28 05:35:12.565505 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 255/479] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:12 2022] GET /compute/v2.1/servers/d2380b3f-75da-4c71-9bf5-bc1b1cb0611b => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:35:13.339554 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-cf3febe5-fc76-416e-b367-de711cbe05df tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:35:13.346335 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-cf3febe5-fc76-416e-b367-de711cbe05df tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:13.346815 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-cf3febe5-fc76-416e-b367-de711cbe05df tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:13.368986 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-cf3febe5-fc76-416e-b367-de711cbe05df tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Going to try to stop instance {{(pid=124482) force_stop /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 05:35:13.541379 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-cf3febe5-fc76-416e-b367-de711cbe05df tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "POST /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268/action" status: 202 len: 0 microversion: 2.1 time: 0.205798 Jul 28 05:35:13.542623 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 256/480] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Jul 28 05:35:13 2022] POST /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 05:35:13.548249 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-e7b90324-8bc4-4c21-b275-6cbf06397ece tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:13.548930 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-e7b90324-8bc4-4c21-b275-6cbf06397ece tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:13.555994 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e7b90324-8bc4-4c21-b275-6cbf06397ece tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:13.565263 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e7b90324-8bc4-4c21-b275-6cbf06397ece tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:13.566257 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e7b90324-8bc4-4c21-b275-6cbf06397ece tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:13.566704 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e7b90324-8bc4-4c21-b275-6cbf06397ece tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:13.706358 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-e7b90324-8bc4-4c21-b275-6cbf06397ece tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:13.719276 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-e7b90324-8bc4-4c21-b275-6cbf06397ece tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9" status: 200 len: 1735 microversion: 2.1 time: 0.175265 Jul 28 05:35:13.720298 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 257/481] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:13 2022] GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:35:13.734820 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-4c563071-ca06-481f-a346-81cafb4a7427 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:13.735554 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-4c563071-ca06-481f-a346-81cafb4a7427 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:13.743114 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4c563071-ca06-481f-a346-81cafb4a7427 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:13.743946 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4c563071-ca06-481f-a346-81cafb4a7427 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:13.744805 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4c563071-ca06-481f-a346-81cafb4a7427 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:13.745362 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4c563071-ca06-481f-a346-81cafb4a7427 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:13.907164 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-4c563071-ca06-481f-a346-81cafb4a7427 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:13.922405 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-4c563071-ca06-481f-a346-81cafb4a7427 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 200 len: 1678 microversion: 2.1 time: 0.192827 Jul 28 05:35:13.923212 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 258/482] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:13 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 1678 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:35:13.927438 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-5bfe299a-992b-4927-b72c-c35d2703765e tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:13.928039 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-5bfe299a-992b-4927-b72c-c35d2703765e tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: d2380b3f-75da-4c71-9bf5-bc1b1cb0611b] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:13.955491 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5bfe299a-992b-4927-b72c-c35d2703765e tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:13.957108 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5bfe299a-992b-4927-b72c-c35d2703765e tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:13.957108 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5bfe299a-992b-4927-b72c-c35d2703765e tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:13.957658 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5bfe299a-992b-4927-b72c-c35d2703765e tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:14.024876 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-5bfe299a-992b-4927-b72c-c35d2703765e tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:14.051792 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-5bfe299a-992b-4927-b72c-c35d2703765e tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/d2380b3f-75da-4c71-9bf5-bc1b1cb0611b" status: 200 len: 1614 microversion: 2.1 time: 0.127400 Jul 28 05:35:14.067033 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 259/483] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:13 2022] GET /compute/v2.1/servers/d2380b3f-75da-4c71-9bf5-bc1b1cb0611b => generated 1614 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:35:14.075020 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-667df793-febe-4373-bff0-a45c8f5fc35b req-872d553b-d18d-4cac-b67e-8c74e3f1e4c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2380b3f-75da-4c71-9bf5-bc1b1cb0611b", "name": "network-vif-deleted", "tag": "cd6c58a9-a2f7-4847-b8ea-62033cb3f2f2"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:35:14.092846 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-667df793-febe-4373-bff0-a45c8f5fc35b req-872d553b-d18d-4cac-b67e-8c74e3f1e4c1 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:14.093313 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-667df793-febe-4373-bff0-a45c8f5fc35b req-872d553b-d18d-4cac-b67e-8c74e3f1e4c1 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:14.106088 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-667df793-febe-4373-bff0-a45c8f5fc35b req-872d553b-d18d-4cac-b67e-8c74e3f1e4c1 service nova] Creating event network-vif-deleted:cd6c58a9-a2f7-4847-b8ea-62033cb3f2f2 for instance d2380b3f-75da-4c71-9bf5-bc1b1cb0611b on hv-cinder-79987 Jul 28 05:35:14.111005 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-667df793-febe-4373-bff0-a45c8f5fc35b req-872d553b-d18d-4cac-b67e-8c74e3f1e4c1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042684 Jul 28 05:35:14.111601 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 260/484] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:35:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:35:14.742044 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-feedb50d-4497-454c-ad19-eb1154632f34 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:14.742741 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-feedb50d-4497-454c-ad19-eb1154632f34 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:14.751002 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-feedb50d-4497-454c-ad19-eb1154632f34 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:14.751664 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-feedb50d-4497-454c-ad19-eb1154632f34 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:14.752489 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-feedb50d-4497-454c-ad19-eb1154632f34 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:14.752930 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-feedb50d-4497-454c-ad19-eb1154632f34 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:14.906506 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-feedb50d-4497-454c-ad19-eb1154632f34 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:14.916766 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-feedb50d-4497-454c-ad19-eb1154632f34 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9" status: 200 len: 1735 microversion: 2.1 time: 0.179322 Jul 28 05:35:14.918343 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 261/485] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:14 2022] GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 => generated 1735 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:35:14.943366 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-8c1ba709-fbf9-46d5-8482-3f0ed7b85110 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:14.943977 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-8c1ba709-fbf9-46d5-8482-3f0ed7b85110 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:14.950364 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8c1ba709-fbf9-46d5-8482-3f0ed7b85110 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:14.950810 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8c1ba709-fbf9-46d5-8482-3f0ed7b85110 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:14.951604 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8c1ba709-fbf9-46d5-8482-3f0ed7b85110 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:14.952039 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8c1ba709-fbf9-46d5-8482-3f0ed7b85110 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:15.101682 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-8c1ba709-fbf9-46d5-8482-3f0ed7b85110 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:15.110610 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-8c1ba709-fbf9-46d5-8482-3f0ed7b85110 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 200 len: 1678 microversion: 2.1 time: 0.170977 Jul 28 05:35:15.113631 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 262/486] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:14 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:35:15.118914 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-2d6f7c49-6d16-4a90-971e-e3f02f2b85d1 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:15.119471 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-2d6f7c49-6d16-4a90-971e-e3f02f2b85d1 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: d2380b3f-75da-4c71-9bf5-bc1b1cb0611b] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:15.126495 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2d6f7c49-6d16-4a90-971e-e3f02f2b85d1 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:15.127160 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2d6f7c49-6d16-4a90-971e-e3f02f2b85d1 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:15.127958 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2d6f7c49-6d16-4a90-971e-e3f02f2b85d1 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:15.128401 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2d6f7c49-6d16-4a90-971e-e3f02f2b85d1 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:15.164444 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2d6f7c49-6d16-4a90-971e-e3f02f2b85d1 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:15.164716 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2d6f7c49-6d16-4a90-971e-e3f02f2b85d1 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:15.165163 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.objects.instance [None req-2d6f7c49-6d16-4a90-971e-e3f02f2b85d1 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lazy-loading 'fault' on Instance uuid d2380b3f-75da-4c71-9bf5-bc1b1cb0611b {{(pid=124482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 05:35:15.170221 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:35:15.212892 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-2d6f7c49-6d16-4a90-971e-e3f02f2b85d1 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:15.220528 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-2d6f7c49-6d16-4a90-971e-e3f02f2b85d1 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/d2380b3f-75da-4c71-9bf5-bc1b1cb0611b" status: 200 len: 1331 microversion: 2.1 time: 0.105608 Jul 28 05:35:15.221106 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 263/487] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:15 2022] GET /compute/v2.1/servers/d2380b3f-75da-4c71-9bf5-bc1b1cb0611b => generated 1331 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:35:15.939572 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-1afa90a3-634e-4fe3-ae9b-c40b5ae2d0f7 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:15.940275 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-1afa90a3-634e-4fe3-ae9b-c40b5ae2d0f7 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:15.947641 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1afa90a3-634e-4fe3-ae9b-c40b5ae2d0f7 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:15.948233 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1afa90a3-634e-4fe3-ae9b-c40b5ae2d0f7 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:15.949090 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1afa90a3-634e-4fe3-ae9b-c40b5ae2d0f7 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:15.950134 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1afa90a3-634e-4fe3-ae9b-c40b5ae2d0f7 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:16.082836 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-1afa90a3-634e-4fe3-ae9b-c40b5ae2d0f7 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:16.090664 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-1afa90a3-634e-4fe3-ae9b-c40b5ae2d0f7 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9" status: 200 len: 1735 microversion: 2.1 time: 0.154912 Jul 28 05:35:16.091179 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 264/488] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:15 2022] GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:35:16.131538 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-179969f6-1802-4fa8-8180-c70aed6f128a tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:16.132141 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-179969f6-1802-4fa8-8180-c70aed6f128a tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:16.138185 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-179969f6-1802-4fa8-8180-c70aed6f128a tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:16.138640 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-179969f6-1802-4fa8-8180-c70aed6f128a tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:16.139413 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-179969f6-1802-4fa8-8180-c70aed6f128a tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:16.139835 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-179969f6-1802-4fa8-8180-c70aed6f128a tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:16.267132 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-179969f6-1802-4fa8-8180-c70aed6f128a tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:16.275153 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-179969f6-1802-4fa8-8180-c70aed6f128a tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 200 len: 1678 microversion: 2.1 time: 0.147000 Jul 28 05:35:16.275658 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 265/489] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:16 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 1678 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:35:16.285615 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-4f92cab7-1a80-4c03-bc21-b61d1dab43ac tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:16.285615 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-4f92cab7-1a80-4c03-bc21-b61d1dab43ac tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: d2380b3f-75da-4c71-9bf5-bc1b1cb0611b] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:16.286794 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4f92cab7-1a80-4c03-bc21-b61d1dab43ac tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:16.287244 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4f92cab7-1a80-4c03-bc21-b61d1dab43ac tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:16.288005 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4f92cab7-1a80-4c03-bc21-b61d1dab43ac tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:16.288512 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4f92cab7-1a80-4c03-bc21-b61d1dab43ac tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:16.303507 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.wsgi [None req-4f92cab7-1a80-4c03-bc21-b61d1dab43ac tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] HTTP exception thrown: Instance d2380b3f-75da-4c71-9bf5-bc1b1cb0611b could not be found. Jul 28 05:35:16.305152 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-4f92cab7-1a80-4c03-bc21-b61d1dab43ac tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Request method failure captured: Jul 28 05:35:16.305152 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: request: GET /compute/v2.1/servers/d2380b3f-75da-4c71-9bf5-bc1b1cb0611b HTTP/1.1 Jul 28 05:35:16.305152 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept: application/json Jul 28 05:35:16.305152 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept-Encoding: identity Jul 28 05:35:16.305152 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Connection: close Jul 28 05:35:16.305152 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Length: 0 Jul 28 05:35:16.305152 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Type: application/json Jul 28 05:35:16.305152 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Host: 10.222.0.33 Jul 28 05:35:16.305152 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Openstack-System-Scope: None Jul 28 05:35:16.305152 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: User-Agent: python-urllib3/1.26.10 Jul 28 05:35:16.305152 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Auth-Token: gAAAAABi4h9D_G9i011T28yIc-ZNvejV_UpI0QoKlXE0FGZ91QFBkrT7qoFtXVHh-pu6aHMGmM56LTiBsS724USe_vuB1sVPXPQos6zopSWxHNIiTv0vnR9zJg55cl6dG7-t6mrt4b6a18Xfa5nEVVolwB-FkmudbFUJziZU1gufozNL3J-fAhg Jul 28 05:35:16.305152 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Id: None Jul 28 05:35:16.305152 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Name: None Jul 28 05:35:16.305152 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Identity-Status: Confirmed Jul 28 05:35:16.305152 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Is-Admin-Project: True Jul 28 05:35:16.305152 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Id: default Jul 28 05:35:16.305152 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Name: Default Jul 28 05:35:16.305152 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Id: ba0b7f7639504a25a73c94335d62b98f Jul 28 05:35:16.305152 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Name: tempest-AttachVolumeNegativeTest-1557602675 Jul 28 05:35:16.305152 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Role: member,reader Jul 28 05:35:16.305152 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Roles: member,reader Jul 28 05:35:16.306691 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ba0b7f7639504a25a73c94335d62b98f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ba0b7f7639504a25a73c94335d62b98f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ba0b7f7639504a25a73c94335d62b98f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ba0b7f7639504a25a73c94335d62b98f"}]}] Jul 28 05:35:16.306691 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant: tempest-AttachVolumeNegativeTest-1557602675 Jul 28 05:35:16.306691 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Id: ba0b7f7639504a25a73c94335d62b98f Jul 28 05:35:16.306691 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1557602675 Jul 28 05:35:16.306691 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User: tempest-AttachVolumeNegativeTest-1557602675-project Jul 28 05:35:16.306691 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Id: default Jul 28 05:35:16.306691 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Name: Default Jul 28 05:35:16.306691 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Id: 0002ebbc629b4dafb109dc94450fe1d8 Jul 28 05:35:16.306691 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Name: tempest-AttachVolumeNegativeTest-1557602675-project Jul 28 05:35:16.306691 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: method: > Jul 28 05:35:16.306691 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: exception: Instance d2380b3f-75da-4c71-9bf5-bc1b1cb0611b could not be found. Jul 28 05:35:16.306691 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: action_args: {'id': 'd2380b3f-75da-4c71-9bf5-bc1b1cb0611b'} Jul 28 05:35:16.308154 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 05:35:16.308154 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:35:16.308154 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 05:35:16.308154 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 05:35:16.308154 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 05:35:16.308154 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 05:35:16.308154 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 05:35:16.308154 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 05:35:16.308154 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 05:35:16.308154 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 05:35:16.308154 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2380b3f-75da-4c71-9bf5-bc1b1cb0611b could not be found. Jul 28 05:35:16.308154 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:35:16.308154 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:35:16.308154 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:35:16.308154 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:35:16.308154 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:35:16.308154 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:35:16.308154 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 05:35:16.308154 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 05:35:16.308154 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 05:35:16.309533 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:35:16.309533 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 05:35:16.309533 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 05:35:16.309533 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 05:35:16.309533 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 05:35:16.309533 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 05:35:16.309533 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 05:35:16.309533 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2380b3f-75da-4c71-9bf5-bc1b1cb0611b could not be found. Jul 28 05:35:16.309533 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:35:16.309533 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:35:16.309533 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:35:16.309533 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:35:16.309533 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:35:16.309533 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:35:16.309533 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 05:35:16.309533 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 05:35:16.309533 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2380b3f-75da-4c71-9bf5-bc1b1cb0611b could not be found. Jul 28 05:35:16.309533 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:35:16.310790 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-4f92cab7-1a80-4c03-bc21-b61d1dab43ac tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Returning 404 to user: Instance d2380b3f-75da-4c71-9bf5-bc1b1cb0611b could not be found. {{(pid=124482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 05:35:16.310790 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-4f92cab7-1a80-4c03-bc21-b61d1dab43ac tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/d2380b3f-75da-4c71-9bf5-bc1b1cb0611b" status: 404 len: 111 microversion: 2.1 time: 0.029820 Jul 28 05:35:16.310790 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 266/490] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:16 2022] GET /compute/v2.1/servers/d2380b3f-75da-4c71-9bf5-bc1b1cb0611b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 05:35:16.315924 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-1b4381c2-2aa9-4f8e-a305-668a0bedbeac tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '.version_select at 0x7f25e03c3af0>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:16.418659 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-1b4381c2-2aa9-4f8e-a305-668a0bedbeac tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-514248105" status: 202 len: 0 microversion: 2.1 time: 0.106170 Jul 28 05:35:16.419154 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 267/491] 10.222.0.33 () {58 vars in 1218 bytes} [Thu Jul 28 05:35:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-514248105 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 05:35:16.423726 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-230fa4a4-db34-4e9f-94cf-12038f76aca2 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:16.424244 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-230fa4a4-db34-4e9f-94cf-12038f76aca2 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] [instance: 2c4200ea-e29d-4c22-bc72-174b478b18fe] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:16.431153 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-230fa4a4-db34-4e9f-94cf-12038f76aca2 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:16.431592 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-230fa4a4-db34-4e9f-94cf-12038f76aca2 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:16.432349 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-230fa4a4-db34-4e9f-94cf-12038f76aca2 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:16.432959 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-230fa4a4-db34-4e9f-94cf-12038f76aca2 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:16.512703 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.objects.instance [None req-230fa4a4-db34-4e9f-94cf-12038f76aca2 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lazy-loading 'services' on Instance uuid 2c4200ea-e29d-4c22-bc72-174b478b18fe {{(pid=124482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 05:35:16.743224 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-230fa4a4-db34-4e9f-94cf-12038f76aca2 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2c4200ea-e29d-4c22-bc72-174b478b18fe/os-volume_attachments/9c1a71f2-3de4-4889-96c3-9f71a51c4753" status: 202 len: 0 microversion: 2.1 time: 0.322842 Jul 28 05:35:16.743819 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 268/492] 10.222.0.33 () {58 vars in 1416 bytes} [Thu Jul 28 05:35:16 2022] DELETE /compute/v2.1/servers/2c4200ea-e29d-4c22-bc72-174b478b18fe/os-volume_attachments/9c1a71f2-3de4-4889-96c3-9f71a51c4753 => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 05:35:17.112889 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-91b0851a-2a46-4adf-8c2c-9db1c06f5635 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:17.113633 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-91b0851a-2a46-4adf-8c2c-9db1c06f5635 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:17.120671 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-91b0851a-2a46-4adf-8c2c-9db1c06f5635 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:17.121118 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-91b0851a-2a46-4adf-8c2c-9db1c06f5635 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:17.121908 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-91b0851a-2a46-4adf-8c2c-9db1c06f5635 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:17.122338 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-91b0851a-2a46-4adf-8c2c-9db1c06f5635 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:17.313324 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-91b0851a-2a46-4adf-8c2c-9db1c06f5635 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:17.321341 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-91b0851a-2a46-4adf-8c2c-9db1c06f5635 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9" status: 200 len: 1735 microversion: 2.1 time: 0.213138 Jul 28 05:35:17.321928 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 269/493] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:17 2022] GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 => generated 1735 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:35:17.326253 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-f63c044e-5120-4dcb-b0e4-8f24d55ee7fe tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:17.327371 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-f63c044e-5120-4dcb-b0e4-8f24d55ee7fe tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:17.332643 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f63c044e-5120-4dcb-b0e4-8f24d55ee7fe tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:17.333083 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f63c044e-5120-4dcb-b0e4-8f24d55ee7fe tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:17.333855 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f63c044e-5120-4dcb-b0e4-8f24d55ee7fe tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:17.334298 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f63c044e-5120-4dcb-b0e4-8f24d55ee7fe tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:17.522570 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-f63c044e-5120-4dcb-b0e4-8f24d55ee7fe tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:17.530937 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-f63c044e-5120-4dcb-b0e4-8f24d55ee7fe tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 200 len: 1678 microversion: 2.1 time: 0.208045 Jul 28 05:35:17.532820 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 270/494] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:17 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 1678 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:35:17.567135 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-cbdf37a1-5e8e-42aa-a106-69f74f7a6c9e tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:17.567627 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-cbdf37a1-5e8e-42aa-a106-69f74f7a6c9e tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: f769843b-cb4a-4599-bf54-49d579601a8a] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:17.574321 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-cbdf37a1-5e8e-42aa-a106-69f74f7a6c9e tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:17.574760 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-cbdf37a1-5e8e-42aa-a106-69f74f7a6c9e tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:17.575503 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-cbdf37a1-5e8e-42aa-a106-69f74f7a6c9e tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:17.575923 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-cbdf37a1-5e8e-42aa-a106-69f74f7a6c9e tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:17.658320 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.objects.instance [None req-cbdf37a1-5e8e-42aa-a106-69f74f7a6c9e tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lazy-loading 'services' on Instance uuid f769843b-cb4a-4599-bf54-49d579601a8a {{(pid=124482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 05:35:17.845773 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-cbdf37a1-5e8e-42aa-a106-69f74f7a6c9e tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a/os-volume_attachments/656850b6-af39-404a-921a-f1cf74d99571" status: 202 len: 0 microversion: 2.1 time: 0.282284 Jul 28 05:35:17.846495 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 271/495] 10.222.0.33 () {58 vars in 1416 bytes} [Thu Jul 28 05:35:17 2022] DELETE /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a/os-volume_attachments/656850b6-af39-404a-921a-f1cf74d99571 => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 05:35:17.855990 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-3b6a7131-8ffc-4922-9876-d02f00fa6d08 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:17.858333 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-3b6a7131-8ffc-4922-9876-d02f00fa6d08 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: f769843b-cb4a-4599-bf54-49d579601a8a] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:17.864583 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3b6a7131-8ffc-4922-9876-d02f00fa6d08 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:17.865030 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3b6a7131-8ffc-4922-9876-d02f00fa6d08 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:17.865818 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3b6a7131-8ffc-4922-9876-d02f00fa6d08 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:17.866256 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3b6a7131-8ffc-4922-9876-d02f00fa6d08 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:17.896239 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-3b6a7131-8ffc-4922-9876-d02f00fa6d08 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045104 Jul 28 05:35:17.896799 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 272/496] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Jul 28 05:35:17 2022] GET /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 05:35:18.343091 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-4379d8a7-21da-405c-94ed-faaccc4c441f tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:18.343649 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-4379d8a7-21da-405c-94ed-faaccc4c441f tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:18.350020 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4379d8a7-21da-405c-94ed-faaccc4c441f tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:18.350462 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4379d8a7-21da-405c-94ed-faaccc4c441f tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:18.351201 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4379d8a7-21da-405c-94ed-faaccc4c441f tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:18.351629 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4379d8a7-21da-405c-94ed-faaccc4c441f tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:18.480644 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-4379d8a7-21da-405c-94ed-faaccc4c441f tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:18.488715 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-4379d8a7-21da-405c-94ed-faaccc4c441f tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9" status: 200 len: 1735 microversion: 2.1 time: 0.150139 Jul 28 05:35:18.489268 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 273/497] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:18 2022] GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:35:18.555725 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-088a46f2-8b34-46d4-bfd3-2c8a546457b6 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:18.556323 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-088a46f2-8b34-46d4-bfd3-2c8a546457b6 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:18.562416 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-088a46f2-8b34-46d4-bfd3-2c8a546457b6 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:18.562858 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-088a46f2-8b34-46d4-bfd3-2c8a546457b6 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:18.563607 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-088a46f2-8b34-46d4-bfd3-2c8a546457b6 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:18.564037 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-088a46f2-8b34-46d4-bfd3-2c8a546457b6 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:18.691085 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-088a46f2-8b34-46d4-bfd3-2c8a546457b6 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:18.699060 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-088a46f2-8b34-46d4-bfd3-2c8a546457b6 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 200 len: 1678 microversion: 2.1 time: 0.146492 Jul 28 05:35:18.699616 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 274/498] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:18 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 1678 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:35:18.908443 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-bfd7f289-23cc-4dd8-985b-7c57d92ea428 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:18.910811 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-bfd7f289-23cc-4dd8-985b-7c57d92ea428 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: f769843b-cb4a-4599-bf54-49d579601a8a] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:18.916845 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-bfd7f289-23cc-4dd8-985b-7c57d92ea428 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:18.917367 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-bfd7f289-23cc-4dd8-985b-7c57d92ea428 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:18.918237 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-bfd7f289-23cc-4dd8-985b-7c57d92ea428 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:18.918766 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-bfd7f289-23cc-4dd8-985b-7c57d92ea428 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:18.947482 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-bfd7f289-23cc-4dd8-985b-7c57d92ea428 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043151 Jul 28 05:35:18.948623 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 275/499] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Jul 28 05:35:18 2022] GET /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 05:35:18.953192 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-1b10cf4e-6ca5-45fe-b141-e74e5ef43c3f tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:18.953712 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-1b10cf4e-6ca5-45fe-b141-e74e5ef43c3f tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] [instance: 2c4200ea-e29d-4c22-bc72-174b478b18fe] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:18.959244 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1b10cf4e-6ca5-45fe-b141-e74e5ef43c3f tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:18.959693 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1b10cf4e-6ca5-45fe-b141-e74e5ef43c3f tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:18.960447 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1b10cf4e-6ca5-45fe-b141-e74e5ef43c3f tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:18.960880 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1b10cf4e-6ca5-45fe-b141-e74e5ef43c3f tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:18.984163 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-1b10cf4e-6ca5-45fe-b141-e74e5ef43c3f tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] [instance: 2c4200ea-e29d-4c22-bc72-174b478b18fe] Going to try to terminate instance {{(pid=124482) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 05:35:19.326441 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-1b10cf4e-6ca5-45fe-b141-e74e5ef43c3f tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2c4200ea-e29d-4c22-bc72-174b478b18fe" status: 204 len: 0 microversion: 2.1 time: 0.376269 Jul 28 05:35:19.327029 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 276/500] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Jul 28 05:35:18 2022] DELETE /compute/v2.1/servers/2c4200ea-e29d-4c22-bc72-174b478b18fe => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 05:35:19.335200 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-7863e0c6-f929-4fac-b217-6d3f5f3a4d14 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:19.335893 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-7863e0c6-f929-4fac-b217-6d3f5f3a4d14 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] [instance: 2c4200ea-e29d-4c22-bc72-174b478b18fe] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:19.341892 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7863e0c6-f929-4fac-b217-6d3f5f3a4d14 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:19.342343 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7863e0c6-f929-4fac-b217-6d3f5f3a4d14 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:19.345936 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7863e0c6-f929-4fac-b217-6d3f5f3a4d14 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:19.345936 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7863e0c6-f929-4fac-b217-6d3f5f3a4d14 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:19.476101 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-7863e0c6-f929-4fac-b217-6d3f5f3a4d14 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02142b6537394571912b52f061aeb082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fafe3a7726844018a6c308f8acdbb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:19.484221 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-7863e0c6-f929-4fac-b217-6d3f5f3a4d14 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] 10.222.0.33 "GET /compute/v2.1/servers/2c4200ea-e29d-4c22-bc72-174b478b18fe" status: 200 len: 1512 microversion: 2.1 time: 0.152952 Jul 28 05:35:19.487000 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 277/501] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:19 2022] GET /compute/v2.1/servers/2c4200ea-e29d-4c22-bc72-174b478b18fe => generated 1512 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:35:19.509811 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-f40ba32a-db33-4c9b-8205-d324797de5d3 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:19.510450 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-f40ba32a-db33-4c9b-8205-d324797de5d3 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:19.516366 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f40ba32a-db33-4c9b-8205-d324797de5d3 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:19.516756 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f40ba32a-db33-4c9b-8205-d324797de5d3 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:19.517535 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f40ba32a-db33-4c9b-8205-d324797de5d3 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:19.517973 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f40ba32a-db33-4c9b-8205-d324797de5d3 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:19.644623 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-f40ba32a-db33-4c9b-8205-d324797de5d3 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:19.647176 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:35:19.654101 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-f40ba32a-db33-4c9b-8205-d324797de5d3 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9" status: 200 len: 1735 microversion: 2.1 time: 0.147923 Jul 28 05:35:19.654665 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 278/502] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:19 2022] GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:35:19.720064 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-89075636-8b6c-49c4-a097-53dd253da939 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:19.720670 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-89075636-8b6c-49c4-a097-53dd253da939 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:19.722729 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:35:19.727658 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-89075636-8b6c-49c4-a097-53dd253da939 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:19.728143 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-89075636-8b6c-49c4-a097-53dd253da939 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:19.728895 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-89075636-8b6c-49c4-a097-53dd253da939 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:19.730069 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-89075636-8b6c-49c4-a097-53dd253da939 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:19.861254 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-89075636-8b6c-49c4-a097-53dd253da939 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:19.868631 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-89075636-8b6c-49c4-a097-53dd253da939 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 200 len: 1678 microversion: 2.1 time: 0.152226 Jul 28 05:35:19.869219 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 279/503] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:19 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:35:19.959636 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-14245799-762f-4d86-a9c0-dc17eb868e98 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:19.961878 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-14245799-762f-4d86-a9c0-dc17eb868e98 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: f769843b-cb4a-4599-bf54-49d579601a8a] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:19.968542 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-14245799-762f-4d86-a9c0-dc17eb868e98 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:19.968982 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-14245799-762f-4d86-a9c0-dc17eb868e98 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:19.969758 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-14245799-762f-4d86-a9c0-dc17eb868e98 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:19.970187 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-14245799-762f-4d86-a9c0-dc17eb868e98 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:19.998925 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-14245799-762f-4d86-a9c0-dc17eb868e98 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043009 Jul 28 05:35:19.999476 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 280/504] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Jul 28 05:35:19 2022] GET /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 05:35:20.505044 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-00c0c27c-9160-4271-b45a-3331fe7c6645 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:20.505693 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-00c0c27c-9160-4271-b45a-3331fe7c6645 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] [instance: 2c4200ea-e29d-4c22-bc72-174b478b18fe] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:20.513070 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-00c0c27c-9160-4271-b45a-3331fe7c6645 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:20.513555 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-00c0c27c-9160-4271-b45a-3331fe7c6645 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:20.514369 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-00c0c27c-9160-4271-b45a-3331fe7c6645 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:20.514752 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-00c0c27c-9160-4271-b45a-3331fe7c6645 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:20.643178 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-00c0c27c-9160-4271-b45a-3331fe7c6645 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02142b6537394571912b52f061aeb082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fafe3a7726844018a6c308f8acdbb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:20.651054 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-00c0c27c-9160-4271-b45a-3331fe7c6645 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] 10.222.0.33 "GET /compute/v2.1/servers/2c4200ea-e29d-4c22-bc72-174b478b18fe" status: 200 len: 1512 microversion: 2.1 time: 0.149715 Jul 28 05:35:20.651754 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 281/505] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:20 2022] GET /compute/v2.1/servers/2c4200ea-e29d-4c22-bc72-174b478b18fe => generated 1512 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:35:20.675590 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-1e30bdf5-02c8-425b-affd-610db423a837 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:20.676220 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-1e30bdf5-02c8-425b-affd-610db423a837 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:20.682198 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1e30bdf5-02c8-425b-affd-610db423a837 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:20.683193 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1e30bdf5-02c8-425b-affd-610db423a837 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:20.683935 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1e30bdf5-02c8-425b-affd-610db423a837 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:20.684361 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1e30bdf5-02c8-425b-affd-610db423a837 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:20.810527 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-1e30bdf5-02c8-425b-affd-610db423a837 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:20.818356 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-1e30bdf5-02c8-425b-affd-610db423a837 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9" status: 200 len: 1735 microversion: 2.1 time: 0.146428 Jul 28 05:35:20.818922 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 282/506] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:20 2022] GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:35:20.889151 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-8d72cf88-5258-43fe-a7f0-8c454bfa10de tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:20.889779 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-8d72cf88-5258-43fe-a7f0-8c454bfa10de tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:20.895832 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8d72cf88-5258-43fe-a7f0-8c454bfa10de tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:20.896278 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8d72cf88-5258-43fe-a7f0-8c454bfa10de tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:20.897031 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8d72cf88-5258-43fe-a7f0-8c454bfa10de tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:20.897481 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8d72cf88-5258-43fe-a7f0-8c454bfa10de tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:21.029909 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-8d72cf88-5258-43fe-a7f0-8c454bfa10de tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:21.037365 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-8d72cf88-5258-43fe-a7f0-8c454bfa10de tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 200 len: 1678 microversion: 2.1 time: 0.152116 Jul 28 05:35:21.037957 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 283/507] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:20 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:35:21.043232 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-093fba69-21b4-40a7-8b77-e3d5f4ca7614 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:21.045439 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-093fba69-21b4-40a7-8b77-e3d5f4ca7614 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: f769843b-cb4a-4599-bf54-49d579601a8a] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:21.051240 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-093fba69-21b4-40a7-8b77-e3d5f4ca7614 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:21.051683 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-093fba69-21b4-40a7-8b77-e3d5f4ca7614 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:21.052433 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-093fba69-21b4-40a7-8b77-e3d5f4ca7614 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:21.052862 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-093fba69-21b4-40a7-8b77-e3d5f4ca7614 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:21.080963 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-093fba69-21b4-40a7-8b77-e3d5f4ca7614 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041959 Jul 28 05:35:21.081444 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 284/508] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Jul 28 05:35:21 2022] GET /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:35:21.672158 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-f7a50eb3-7edd-46df-a017-4d131ae2c105 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:21.672810 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-f7a50eb3-7edd-46df-a017-4d131ae2c105 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] [instance: 2c4200ea-e29d-4c22-bc72-174b478b18fe] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:21.679151 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f7a50eb3-7edd-46df-a017-4d131ae2c105 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:21.679587 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f7a50eb3-7edd-46df-a017-4d131ae2c105 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:21.680354 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f7a50eb3-7edd-46df-a017-4d131ae2c105 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:21.680782 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f7a50eb3-7edd-46df-a017-4d131ae2c105 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:21.814106 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-f7a50eb3-7edd-46df-a017-4d131ae2c105 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02142b6537394571912b52f061aeb082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fafe3a7726844018a6c308f8acdbb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:21.821869 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-f7a50eb3-7edd-46df-a017-4d131ae2c105 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] 10.222.0.33 "GET /compute/v2.1/servers/2c4200ea-e29d-4c22-bc72-174b478b18fe" status: 200 len: 1512 microversion: 2.1 time: 0.153387 Jul 28 05:35:21.822455 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 285/509] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:21 2022] GET /compute/v2.1/servers/2c4200ea-e29d-4c22-bc72-174b478b18fe => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:35:21.839437 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-9f8f3bda-c765-47c9-94da-c409b8f28ed7 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:21.841278 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-9f8f3bda-c765-47c9-94da-c409b8f28ed7 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:21.845992 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9f8f3bda-c765-47c9-94da-c409b8f28ed7 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:21.846438 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9f8f3bda-c765-47c9-94da-c409b8f28ed7 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:21.847194 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9f8f3bda-c765-47c9-94da-c409b8f28ed7 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:21.847632 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9f8f3bda-c765-47c9-94da-c409b8f28ed7 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:21.984134 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-9f8f3bda-c765-47c9-94da-c409b8f28ed7 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:21.992039 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-9f8f3bda-c765-47c9-94da-c409b8f28ed7 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9" status: 200 len: 1735 microversion: 2.1 time: 0.156508 Jul 28 05:35:21.992612 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 286/510] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:21 2022] GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:35:22.059733 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-8fa7f933-9730-45bf-87da-44aff8ecfd35 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:22.060396 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-8fa7f933-9730-45bf-87da-44aff8ecfd35 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:22.066490 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8fa7f933-9730-45bf-87da-44aff8ecfd35 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:22.066939 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8fa7f933-9730-45bf-87da-44aff8ecfd35 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:22.067690 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8fa7f933-9730-45bf-87da-44aff8ecfd35 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:22.068125 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8fa7f933-9730-45bf-87da-44aff8ecfd35 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:22.197104 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-8fa7f933-9730-45bf-87da-44aff8ecfd35 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:22.205110 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-8fa7f933-9730-45bf-87da-44aff8ecfd35 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 200 len: 1678 microversion: 2.1 time: 0.149780 Jul 28 05:35:22.205702 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 287/511] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:22 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:35:22.210185 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-8e3fb836-a52c-477a-8efa-5283174210e9 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:22.212328 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-8e3fb836-a52c-477a-8efa-5283174210e9 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: f769843b-cb4a-4599-bf54-49d579601a8a] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:22.218479 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8e3fb836-a52c-477a-8efa-5283174210e9 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:22.218919 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8e3fb836-a52c-477a-8efa-5283174210e9 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:22.220316 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8e3fb836-a52c-477a-8efa-5283174210e9 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:22.220316 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8e3fb836-a52c-477a-8efa-5283174210e9 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:22.251311 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-8e3fb836-a52c-477a-8efa-5283174210e9 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044555 Jul 28 05:35:22.252210 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 288/512] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Jul 28 05:35:22 2022] GET /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:35:22.759777 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-4807a3ac-0efd-4e6a-a25c-d0de67490449 req-b895f94f-be75-4d6a-94f9-09fe4bf678c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c4200ea-e29d-4c22-bc72-174b478b18fe", "name": "network-vif-deleted", "tag": "ad525c4e-158a-4aa3-9d2c-e4f773a1dd4b"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:35:22.771077 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-4807a3ac-0efd-4e6a-a25c-d0de67490449 req-b895f94f-be75-4d6a-94f9-09fe4bf678c8 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:22.775737 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-4807a3ac-0efd-4e6a-a25c-d0de67490449 req-b895f94f-be75-4d6a-94f9-09fe4bf678c8 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:22.782879 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-4807a3ac-0efd-4e6a-a25c-d0de67490449 req-b895f94f-be75-4d6a-94f9-09fe4bf678c8 service nova] Creating event network-vif-deleted:ad525c4e-158a-4aa3-9d2c-e4f773a1dd4b for instance 2c4200ea-e29d-4c22-bc72-174b478b18fe on hv-cinder-79987 Jul 28 05:35:22.787609 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-4807a3ac-0efd-4e6a-a25c-d0de67490449 req-b895f94f-be75-4d6a-94f9-09fe4bf678c8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031507 Jul 28 05:35:22.788179 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 289/513] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:35:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 05:35:22.843920 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-ee5a5940-137f-4fef-8e77-428d8f2ee0be tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:22.844525 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-ee5a5940-137f-4fef-8e77-428d8f2ee0be tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] [instance: 2c4200ea-e29d-4c22-bc72-174b478b18fe] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:22.850837 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ee5a5940-137f-4fef-8e77-428d8f2ee0be tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:22.851275 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ee5a5940-137f-4fef-8e77-428d8f2ee0be tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:22.852025 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ee5a5940-137f-4fef-8e77-428d8f2ee0be tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:22.852449 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ee5a5940-137f-4fef-8e77-428d8f2ee0be tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:22.915478 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-ee5a5940-137f-4fef-8e77-428d8f2ee0be tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02142b6537394571912b52f061aeb082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fafe3a7726844018a6c308f8acdbb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:22.923502 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-ee5a5940-137f-4fef-8e77-428d8f2ee0be tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] 10.222.0.33 "GET /compute/v2.1/servers/2c4200ea-e29d-4c22-bc72-174b478b18fe" status: 200 len: 1470 microversion: 2.1 time: 0.083793 Jul 28 05:35:22.924068 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 290/514] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:22 2022] GET /compute/v2.1/servers/2c4200ea-e29d-4c22-bc72-174b478b18fe => generated 1470 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:35:23.013659 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-df5017a8-d977-45bd-87f5-428b24205882 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:23.016541 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-df5017a8-d977-45bd-87f5-428b24205882 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:23.020670 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-df5017a8-d977-45bd-87f5-428b24205882 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:23.021231 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-df5017a8-d977-45bd-87f5-428b24205882 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:23.022020 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-df5017a8-d977-45bd-87f5-428b24205882 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:23.022575 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-df5017a8-d977-45bd-87f5-428b24205882 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:23.154944 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-df5017a8-d977-45bd-87f5-428b24205882 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:23.162886 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-df5017a8-d977-45bd-87f5-428b24205882 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9" status: 200 len: 1735 microversion: 2.1 time: 0.153130 Jul 28 05:35:23.163451 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 291/515] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:23 2022] GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:35:23.226838 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-dd1f9472-96d3-458b-beed-2d9fda46f1cc tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:23.227446 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-dd1f9472-96d3-458b-beed-2d9fda46f1cc tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:23.233985 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-dd1f9472-96d3-458b-beed-2d9fda46f1cc tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:23.234432 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-dd1f9472-96d3-458b-beed-2d9fda46f1cc tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:23.235188 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-dd1f9472-96d3-458b-beed-2d9fda46f1cc tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:23.235625 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-dd1f9472-96d3-458b-beed-2d9fda46f1cc tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:23.361601 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-dd1f9472-96d3-458b-beed-2d9fda46f1cc tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:23.368860 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-dd1f9472-96d3-458b-beed-2d9fda46f1cc tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 200 len: 1678 microversion: 2.1 time: 0.145684 Jul 28 05:35:23.369423 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 292/516] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:23 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 1678 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:35:23.374031 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-a07f4c82-6a02-4970-b9de-4362c175e442 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:23.376246 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-a07f4c82-6a02-4970-b9de-4362c175e442 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: f769843b-cb4a-4599-bf54-49d579601a8a] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:23.381741 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a07f4c82-6a02-4970-b9de-4362c175e442 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:23.382181 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a07f4c82-6a02-4970-b9de-4362c175e442 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:23.382920 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a07f4c82-6a02-4970-b9de-4362c175e442 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:23.383344 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a07f4c82-6a02-4970-b9de-4362c175e442 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:23.412649 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-a07f4c82-6a02-4970-b9de-4362c175e442 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042179 Jul 28 05:35:23.413191 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 293/517] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Jul 28 05:35:23 2022] GET /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 05:35:23.472788 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-3e47a911-cc15-4b7a-bdd7-17dc44d88c76 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:23.473280 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-3e47a911-cc15-4b7a-bdd7-17dc44d88c76 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: f769843b-cb4a-4599-bf54-49d579601a8a] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:23.479204 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3e47a911-cc15-4b7a-bdd7-17dc44d88c76 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:23.480162 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3e47a911-cc15-4b7a-bdd7-17dc44d88c76 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:23.480902 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3e47a911-cc15-4b7a-bdd7-17dc44d88c76 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:23.481329 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3e47a911-cc15-4b7a-bdd7-17dc44d88c76 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:23.504691 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-3e47a911-cc15-4b7a-bdd7-17dc44d88c76 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: f769843b-cb4a-4599-bf54-49d579601a8a] Going to try to terminate instance {{(pid=124482) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 05:35:23.627370 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:35:23.799873 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-3e47a911-cc15-4b7a-bdd7-17dc44d88c76 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a" status: 204 len: 0 microversion: 2.1 time: 0.330455 Jul 28 05:35:23.800644 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 294/518] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Jul 28 05:35:23 2022] DELETE /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 05:35:23.808920 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-d2091f82-2172-4c43-9528-aa6bc95ed533 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:23.809646 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-d2091f82-2172-4c43-9528-aa6bc95ed533 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: f769843b-cb4a-4599-bf54-49d579601a8a] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:23.815639 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d2091f82-2172-4c43-9528-aa6bc95ed533 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:23.816086 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d2091f82-2172-4c43-9528-aa6bc95ed533 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:23.816841 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d2091f82-2172-4c43-9528-aa6bc95ed533 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:23.817274 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d2091f82-2172-4c43-9528-aa6bc95ed533 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:23.952868 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-d2091f82-2172-4c43-9528-aa6bc95ed533 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:23.960306 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-d2091f82-2172-4c43-9528-aa6bc95ed533 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a" status: 200 len: 1682 microversion: 2.1 time: 0.155411 Jul 28 05:35:23.960870 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 295/519] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:23 2022] GET /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:35:23.965143 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-977a3bf6-32d6-4f94-b03b-b204b1ebb22a tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:23.965784 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-977a3bf6-32d6-4f94-b03b-b204b1ebb22a tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] [instance: 2c4200ea-e29d-4c22-bc72-174b478b18fe] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:23.971448 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-977a3bf6-32d6-4f94-b03b-b204b1ebb22a tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:23.971890 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-977a3bf6-32d6-4f94-b03b-b204b1ebb22a tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:23.972633 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-977a3bf6-32d6-4f94-b03b-b204b1ebb22a tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:23.973058 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-977a3bf6-32d6-4f94-b03b-b204b1ebb22a tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:24.002827 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-977a3bf6-32d6-4f94-b03b-b204b1ebb22a tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:24.003264 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-977a3bf6-32d6-4f94-b03b-b204b1ebb22a tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:24.003699 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.objects.instance [None req-977a3bf6-32d6-4f94-b03b-b204b1ebb22a tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lazy-loading 'fault' on Instance uuid 2c4200ea-e29d-4c22-bc72-174b478b18fe {{(pid=124482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 05:35:24.047247 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-977a3bf6-32d6-4f94-b03b-b204b1ebb22a tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02142b6537394571912b52f061aeb082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fafe3a7726844018a6c308f8acdbb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:24.054675 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-977a3bf6-32d6-4f94-b03b-b204b1ebb22a tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] 10.222.0.33 "GET /compute/v2.1/servers/2c4200ea-e29d-4c22-bc72-174b478b18fe" status: 200 len: 1308 microversion: 2.1 time: 0.092885 Jul 28 05:35:24.055257 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 296/520] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:23 2022] GET /compute/v2.1/servers/2c4200ea-e29d-4c22-bc72-174b478b18fe => generated 1308 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:35:24.185620 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-a584b0eb-a657-4818-808f-206813bd9ed7 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:24.186169 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-a584b0eb-a657-4818-808f-206813bd9ed7 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:24.191992 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a584b0eb-a657-4818-808f-206813bd9ed7 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:24.192428 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a584b0eb-a657-4818-808f-206813bd9ed7 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:24.193169 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a584b0eb-a657-4818-808f-206813bd9ed7 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:24.193625 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a584b0eb-a657-4818-808f-206813bd9ed7 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:24.321625 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-a584b0eb-a657-4818-808f-206813bd9ed7 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:24.329449 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-a584b0eb-a657-4818-808f-206813bd9ed7 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9" status: 200 len: 1715 microversion: 2.1 time: 0.148354 Jul 28 05:35:24.330031 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 297/521] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:24 2022] GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 => generated 1715 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:35:24.388641 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-26bfd1cd-1d76-4158-a5ee-cd496c3d15d4 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:24.389243 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-26bfd1cd-1d76-4158-a5ee-cd496c3d15d4 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:24.395357 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-26bfd1cd-1d76-4158-a5ee-cd496c3d15d4 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:24.395795 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-26bfd1cd-1d76-4158-a5ee-cd496c3d15d4 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:24.396537 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-26bfd1cd-1d76-4158-a5ee-cd496c3d15d4 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:24.396972 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-26bfd1cd-1d76-4158-a5ee-cd496c3d15d4 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:24.527579 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-26bfd1cd-1d76-4158-a5ee-cd496c3d15d4 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:24.534936 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-26bfd1cd-1d76-4158-a5ee-cd496c3d15d4 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 200 len: 1678 microversion: 2.1 time: 0.150136 Jul 28 05:35:24.535504 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 298/522] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:24 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:35:24.539905 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-de1dd9d2-08cb-42bb-8005-571e25cc929e tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:24.540385 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-de1dd9d2-08cb-42bb-8005-571e25cc929e tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:24.546397 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-de1dd9d2-08cb-42bb-8005-571e25cc929e tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:24.546837 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-de1dd9d2-08cb-42bb-8005-571e25cc929e tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:24.547582 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-de1dd9d2-08cb-42bb-8005-571e25cc929e tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:24.548006 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-de1dd9d2-08cb-42bb-8005-571e25cc929e tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:24.628847 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.wsgi [None req-de1dd9d2-08cb-42bb-8005-571e25cc929e tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] HTTP exception thrown: Cannot 'detach_volume' instance 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 while it is in vm_state rescued Jul 28 05:35:24.642140 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-de1dd9d2-08cb-42bb-8005-571e25cc929e tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Request method failure captured: Jul 28 05:35:24.642140 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: request: DELETE /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9/os-volume_attachments/694e0bbd-d0e5-40df-96d2-516672ea911a HTTP/1.1 Jul 28 05:35:24.642140 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept: application/json Jul 28 05:35:24.642140 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept-Encoding: identity Jul 28 05:35:24.642140 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Connection: close Jul 28 05:35:24.642140 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Length: 0 Jul 28 05:35:24.642140 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Type: application/json Jul 28 05:35:24.642140 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Host: 10.222.0.33 Jul 28 05:35:24.642140 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Openstack-System-Scope: None Jul 28 05:35:24.642140 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: User-Agent: python-urllib3/1.26.10 Jul 28 05:35:24.642140 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Auth-Token: gAAAAABi4h84wg4qlFIi1MM6witAk51FDE4BLzXqxMfe6k0jq8CFmcbtqdoBS3AevDrKaw3dmOujUkImtAsInpNCwgYRxMei_nfojXNroWNTr6vsZakpdR__3W76-XDu4xyFhZj-aUFliI2k9fmeYH-hK9oTm36uOAQrbt51a7XSRrj7_QKgyu0 Jul 28 05:35:24.642140 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Id: None Jul 28 05:35:24.642140 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Name: None Jul 28 05:35:24.642140 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Identity-Status: Confirmed Jul 28 05:35:24.642140 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Is-Admin-Project: True Jul 28 05:35:24.642140 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Id: default Jul 28 05:35:24.642140 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Name: Default Jul 28 05:35:24.642140 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Id: 99f094bca18d4939bb22f8d076d3a35c Jul 28 05:35:24.642140 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1728283555 Jul 28 05:35:24.642140 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Role: member,reader Jul 28 05:35:24.642140 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Roles: member,reader Jul 28 05:35:24.643756 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/99f094bca18d4939bb22f8d076d3a35c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/99f094bca18d4939bb22f8d076d3a35c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_99f094bca18d4939bb22f8d076d3a35c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/99f094bca18d4939bb22f8d076d3a35c"}]}] Jul 28 05:35:24.643756 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1728283555 Jul 28 05:35:24.643756 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Id: 99f094bca18d4939bb22f8d076d3a35c Jul 28 05:35:24.643756 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1728283555 Jul 28 05:35:24.643756 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User: tempest-ServerRescueNegativeTestJSON-1728283555-project Jul 28 05:35:24.643756 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Id: default Jul 28 05:35:24.643756 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Name: Default Jul 28 05:35:24.643756 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Id: 4fcc81558e8f4224ad2ea6fb2b7bf0f9 Jul 28 05:35:24.643756 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1728283555-project Jul 28 05:35:24.643756 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: method: > Jul 28 05:35:24.643756 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: exception: Cannot 'detach_volume' instance 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 while it is in vm_state rescued Jul 28 05:35:24.644639 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: action_args: {'server_id': '9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9', 'id': '694e0bbd-d0e5-40df-96d2-516672ea911a'} Jul 28 05:35:24.644639 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 05:35:24.644639 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:35:24.644639 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 28 05:35:24.644639 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 28 05:35:24.644639 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 05:35:24.644639 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 05:35:24.644639 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Jul 28 05:35:24.644639 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 28 05:35:24.644639 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 28 05:35:24.644639 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:35:24.644639 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:35:24.644639 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:35:24.644639 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:35:24.644639 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:35:24.644639 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:35:24.644639 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 05:35:24.644639 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 05:35:24.644639 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 05:35:24.644639 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:35:24.646315 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 28 05:35:24.646315 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 28 05:35:24.646315 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 28 05:35:24.646315 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 28 05:35:24.646315 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 while it is in vm_state rescued Jul 28 05:35:24.646315 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:35:24.646315 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:35:24.646315 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:35:24.646315 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:35:24.646315 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:35:24.646315 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:35:24.646315 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 05:35:24.646315 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 05:35:24.646315 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 while it is in vm_state rescued Jul 28 05:35:24.646315 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:35:24.646315 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-de1dd9d2-08cb-42bb-8005-571e25cc929e tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Returning 409 to user: Cannot 'detach_volume' instance 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 while it is in vm_state rescued {{(pid=124482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 05:35:24.647431 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-de1dd9d2-08cb-42bb-8005-571e25cc929e tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9/os-volume_attachments/694e0bbd-d0e5-40df-96d2-516672ea911a" status: 409 len: 152 microversion: 2.1 time: 0.095457 Jul 28 05:35:24.647431 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 299/523] 10.222.0.33 () {58 vars in 1416 bytes} [Thu Jul 28 05:35:24 2022] DELETE /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9/os-volume_attachments/694e0bbd-d0e5-40df-96d2-516672ea911a => generated 152 bytes in 96 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 28 05:35:24.649001 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-b63650b7-7f56-45bb-b3ad-87027a1cffc3 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:35:24.649555 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-b63650b7-7f56-45bb-b3ad-87027a1cffc3 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:24.656799 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b63650b7-7f56-45bb-b3ad-87027a1cffc3 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:24.657241 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b63650b7-7f56-45bb-b3ad-87027a1cffc3 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:24.658017 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b63650b7-7f56-45bb-b3ad-87027a1cffc3 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:24.658446 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b63650b7-7f56-45bb-b3ad-87027a1cffc3 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:24.866900 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-b63650b7-7f56-45bb-b3ad-87027a1cffc3 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "POST /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9/action" status: 202 len: 0 microversion: 2.1 time: 0.221483 Jul 28 05:35:24.867609 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 300/524] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Jul 28 05:35:24 2022] POST /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 05:35:24.875859 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-23e64a76-716d-49f5-a424-3581adfd0953 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:24.877833 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-23e64a76-716d-49f5-a424-3581adfd0953 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:24.882628 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-23e64a76-716d-49f5-a424-3581adfd0953 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:24.883077 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-23e64a76-716d-49f5-a424-3581adfd0953 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:24.883838 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-23e64a76-716d-49f5-a424-3581adfd0953 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:24.884303 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-23e64a76-716d-49f5-a424-3581adfd0953 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:25.017096 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-23e64a76-716d-49f5-a424-3581adfd0953 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:25.025870 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-23e64a76-716d-49f5-a424-3581adfd0953 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9" status: 200 len: 1723 microversion: 2.1 time: 0.153995 Jul 28 05:35:25.027032 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 301/525] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:24 2022] GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:35:25.031332 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-45847635-e1dc-4467-91c4-e5ebce2c7950 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:25.031939 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-45847635-e1dc-4467-91c4-e5ebce2c7950 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: f769843b-cb4a-4599-bf54-49d579601a8a] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:25.037681 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-45847635-e1dc-4467-91c4-e5ebce2c7950 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:25.038125 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-45847635-e1dc-4467-91c4-e5ebce2c7950 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:25.038936 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-45847635-e1dc-4467-91c4-e5ebce2c7950 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:25.039372 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-45847635-e1dc-4467-91c4-e5ebce2c7950 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:25.168490 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-45847635-e1dc-4467-91c4-e5ebce2c7950 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:25.175898 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-45847635-e1dc-4467-91c4-e5ebce2c7950 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a" status: 200 len: 1682 microversion: 2.1 time: 0.147919 Jul 28 05:35:25.176529 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 302/526] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:25 2022] GET /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a => generated 1682 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:35:25.180792 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-64de66a2-d1b1-4815-b09e-2b738645f058 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:25.181384 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-64de66a2-d1b1-4815-b09e-2b738645f058 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] [instance: 2c4200ea-e29d-4c22-bc72-174b478b18fe] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:25.187788 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-64de66a2-d1b1-4815-b09e-2b738645f058 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:25.188232 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-64de66a2-d1b1-4815-b09e-2b738645f058 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:25.188981 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-64de66a2-d1b1-4815-b09e-2b738645f058 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:25.189412 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-64de66a2-d1b1-4815-b09e-2b738645f058 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:25.218814 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-64de66a2-d1b1-4815-b09e-2b738645f058 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:25.219254 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-64de66a2-d1b1-4815-b09e-2b738645f058 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:25.219697 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.objects.instance [None req-64de66a2-d1b1-4815-b09e-2b738645f058 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lazy-loading 'fault' on Instance uuid 2c4200ea-e29d-4c22-bc72-174b478b18fe {{(pid=124482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 05:35:25.260235 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-64de66a2-d1b1-4815-b09e-2b738645f058 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02142b6537394571912b52f061aeb082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fafe3a7726844018a6c308f8acdbb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:25.268226 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-64de66a2-d1b1-4815-b09e-2b738645f058 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] 10.222.0.33 "GET /compute/v2.1/servers/2c4200ea-e29d-4c22-bc72-174b478b18fe" status: 200 len: 1308 microversion: 2.1 time: 0.090730 Jul 28 05:35:25.268802 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 303/527] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:25 2022] GET /compute/v2.1/servers/2c4200ea-e29d-4c22-bc72-174b478b18fe => generated 1308 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:35:25.556763 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-ab9a9daa-5a8e-43b8-adbd-1aefd0f001a9 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:25.557905 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-ab9a9daa-5a8e-43b8-adbd-1aefd0f001a9 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:25.563981 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ab9a9daa-5a8e-43b8-adbd-1aefd0f001a9 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:25.564434 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ab9a9daa-5a8e-43b8-adbd-1aefd0f001a9 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:25.565192 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ab9a9daa-5a8e-43b8-adbd-1aefd0f001a9 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:25.565657 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ab9a9daa-5a8e-43b8-adbd-1aefd0f001a9 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:25.698532 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-ab9a9daa-5a8e-43b8-adbd-1aefd0f001a9 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:25.706135 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-ab9a9daa-5a8e-43b8-adbd-1aefd0f001a9 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 200 len: 1678 microversion: 2.1 time: 0.153219 Jul 28 05:35:25.706703 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 304/528] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:25 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:35:26.048290 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-ad4f2b70-1279-4251-a542-cb13d822c95a tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:26.049422 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-ad4f2b70-1279-4251-a542-cb13d822c95a tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:26.055731 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ad4f2b70-1279-4251-a542-cb13d822c95a tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:26.056262 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ad4f2b70-1279-4251-a542-cb13d822c95a tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:26.057111 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ad4f2b70-1279-4251-a542-cb13d822c95a tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:26.057688 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ad4f2b70-1279-4251-a542-cb13d822c95a tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:26.352395 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-ad4f2b70-1279-4251-a542-cb13d822c95a tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:26.360297 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-ad4f2b70-1279-4251-a542-cb13d822c95a tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9" status: 200 len: 1723 microversion: 2.1 time: 0.315898 Jul 28 05:35:26.360905 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 305/529] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:26 2022] GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 => generated 1723 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:35:26.366763 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-c9aa2471-fff9-4668-a19b-a6d82b1bfada tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:26.367531 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-c9aa2471-fff9-4668-a19b-a6d82b1bfada tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: f769843b-cb4a-4599-bf54-49d579601a8a] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:26.377937 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c9aa2471-fff9-4668-a19b-a6d82b1bfada tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:26.378393 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c9aa2471-fff9-4668-a19b-a6d82b1bfada tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:26.379161 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c9aa2471-fff9-4668-a19b-a6d82b1bfada tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:26.379594 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c9aa2471-fff9-4668-a19b-a6d82b1bfada tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:26.548055 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-c9aa2471-fff9-4668-a19b-a6d82b1bfada tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:26.555522 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-c9aa2471-fff9-4668-a19b-a6d82b1bfada tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a" status: 200 len: 1682 microversion: 2.1 time: 0.193683 Jul 28 05:35:26.556082 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 306/530] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:26 2022] GET /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a => generated 1682 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:35:26.560461 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-047f8f9f-04f4-4969-8feb-3fcd41b268a7 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:26.561053 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-047f8f9f-04f4-4969-8feb-3fcd41b268a7 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] [instance: 2c4200ea-e29d-4c22-bc72-174b478b18fe] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:26.566822 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-047f8f9f-04f4-4969-8feb-3fcd41b268a7 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:26.567259 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-047f8f9f-04f4-4969-8feb-3fcd41b268a7 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:26.568001 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-047f8f9f-04f4-4969-8feb-3fcd41b268a7 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:26.568425 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-047f8f9f-04f4-4969-8feb-3fcd41b268a7 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:26.582587 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.wsgi [None req-047f8f9f-04f4-4969-8feb-3fcd41b268a7 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] HTTP exception thrown: Instance 2c4200ea-e29d-4c22-bc72-174b478b18fe could not be found. Jul 28 05:35:26.584222 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-047f8f9f-04f4-4969-8feb-3fcd41b268a7 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Request method failure captured: Jul 28 05:35:26.584222 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: request: GET /compute/v2.1/servers/2c4200ea-e29d-4c22-bc72-174b478b18fe HTTP/1.1 Jul 28 05:35:26.584222 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept: application/json Jul 28 05:35:26.584222 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept-Encoding: identity Jul 28 05:35:26.584222 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Connection: close Jul 28 05:35:26.584222 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Length: 0 Jul 28 05:35:26.584222 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Type: application/json Jul 28 05:35:26.584222 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Host: 10.222.0.33 Jul 28 05:35:26.584222 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Openstack-System-Scope: None Jul 28 05:35:26.584222 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: User-Agent: python-urllib3/1.26.10 Jul 28 05:35:26.584222 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Auth-Token: gAAAAABi4h9-mfoXU7i0Xn7mAnk0nvB4d43Vw0PLNX-Nilniu-7Tis7jDXlDZSb6sM8ZlpFbDSpgDOpa-gxCY0Cfr7Ka5DsmgBLCwaq8ai8MtTo65sPxUHoK6ViFhBr_a0vKUXVg0t_tOGUxV0gUwxugqQggtGyA-L886lZKp7DEJhxmcutGtoY Jul 28 05:35:26.584222 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Id: None Jul 28 05:35:26.584222 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Name: None Jul 28 05:35:26.584222 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Identity-Status: Confirmed Jul 28 05:35:26.584222 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Is-Admin-Project: True Jul 28 05:35:26.584222 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Id: default Jul 28 05:35:26.584222 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Name: Default Jul 28 05:35:26.584222 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Id: 0fafe3a7726844018a6c308f8acdbb49 Jul 28 05:35:26.584222 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Name: tempest-VolumesSnapshotTestJSON-451779272 Jul 28 05:35:26.584222 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Role: member,reader Jul 28 05:35:26.584222 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Roles: member,reader Jul 28 05:35:26.585780 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0fafe3a7726844018a6c308f8acdbb49"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0fafe3a7726844018a6c308f8acdbb49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0fafe3a7726844018a6c308f8acdbb49", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0fafe3a7726844018a6c308f8acdbb49"}]}] Jul 28 05:35:26.585780 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant: tempest-VolumesSnapshotTestJSON-451779272 Jul 28 05:35:26.585780 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Id: 0fafe3a7726844018a6c308f8acdbb49 Jul 28 05:35:26.585780 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-451779272 Jul 28 05:35:26.585780 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User: tempest-VolumesSnapshotTestJSON-451779272-project Jul 28 05:35:26.585780 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Id: default Jul 28 05:35:26.585780 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Name: Default Jul 28 05:35:26.585780 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Id: 02142b6537394571912b52f061aeb082 Jul 28 05:35:26.585780 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Name: tempest-VolumesSnapshotTestJSON-451779272-project Jul 28 05:35:26.585780 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: method: > Jul 28 05:35:26.585780 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: exception: Instance 2c4200ea-e29d-4c22-bc72-174b478b18fe could not be found. Jul 28 05:35:26.585780 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: action_args: {'id': '2c4200ea-e29d-4c22-bc72-174b478b18fe'} Jul 28 05:35:26.586714 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 05:35:26.586714 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:35:26.586714 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 05:35:26.586714 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 05:35:26.586714 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 05:35:26.586714 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 05:35:26.586714 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 05:35:26.586714 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 05:35:26.586714 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 05:35:26.586714 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 05:35:26.586714 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c4200ea-e29d-4c22-bc72-174b478b18fe could not be found. Jul 28 05:35:26.586714 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:35:26.586714 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:35:26.586714 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:35:26.586714 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:35:26.586714 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:35:26.586714 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:35:26.586714 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 05:35:26.586714 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 05:35:26.586714 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 05:35:26.588427 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:35:26.588427 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 05:35:26.588427 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 05:35:26.588427 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 05:35:26.588427 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 05:35:26.588427 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 05:35:26.588427 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 05:35:26.588427 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c4200ea-e29d-4c22-bc72-174b478b18fe could not be found. Jul 28 05:35:26.588427 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:35:26.588427 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:35:26.588427 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:35:26.588427 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:35:26.588427 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:35:26.588427 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:35:26.588427 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 05:35:26.588427 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 05:35:26.588427 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c4200ea-e29d-4c22-bc72-174b478b18fe could not be found. Jul 28 05:35:26.588427 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:35:26.590145 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-047f8f9f-04f4-4969-8feb-3fcd41b268a7 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] Returning 404 to user: Instance 2c4200ea-e29d-4c22-bc72-174b478b18fe could not be found. {{(pid=124482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 05:35:26.590145 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-047f8f9f-04f4-4969-8feb-3fcd41b268a7 tempest-VolumesSnapshotTestJSON-451779272 tempest-VolumesSnapshotTestJSON-451779272-project] 10.222.0.33 "GET /compute/v2.1/servers/2c4200ea-e29d-4c22-bc72-174b478b18fe" status: 404 len: 111 microversion: 2.1 time: 0.028607 Jul 28 05:35:26.590145 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 307/531] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:26 2022] GET /compute/v2.1/servers/2c4200ea-e29d-4c22-bc72-174b478b18fe => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 05:35:26.601217 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-9d7ad67a-892d-42d0-be16-1cdf7ea4e145 req-df199968-a287-48f4-9092-d9a2d1da8b17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f769843b-cb4a-4599-bf54-49d579601a8a", "name": "network-vif-unplugged", "status": "completed", "tag": "b006268e-0b66-4d7e-8674-41ac5075555d"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:35:26.610313 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-9d7ad67a-892d-42d0-be16-1cdf7ea4e145 req-df199968-a287-48f4-9092-d9a2d1da8b17 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:26.610313 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-9d7ad67a-892d-42d0-be16-1cdf7ea4e145 req-df199968-a287-48f4-9092-d9a2d1da8b17 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:26.623826 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-9d7ad67a-892d-42d0-be16-1cdf7ea4e145 req-df199968-a287-48f4-9092-d9a2d1da8b17 service nova] Creating event network-vif-unplugged:b006268e-0b66-4d7e-8674-41ac5075555d for instance f769843b-cb4a-4599-bf54-49d579601a8a on hv-cinder-79987 Jul 28 05:35:26.628668 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-9d7ad67a-892d-42d0-be16-1cdf7ea4e145 req-df199968-a287-48f4-9092-d9a2d1da8b17 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040935 Jul 28 05:35:26.629513 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 308/532] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:35:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:35:26.728720 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-b57aaead-9e12-4ca8-811a-0631ce60240d tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:26.729571 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-b57aaead-9e12-4ca8-811a-0631ce60240d tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:26.736910 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b57aaead-9e12-4ca8-811a-0631ce60240d tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:26.743504 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b57aaead-9e12-4ca8-811a-0631ce60240d tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:26.743504 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b57aaead-9e12-4ca8-811a-0631ce60240d tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:26.743504 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b57aaead-9e12-4ca8-811a-0631ce60240d tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:26.928761 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-b57aaead-9e12-4ca8-811a-0631ce60240d tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:26.937061 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-b57aaead-9e12-4ca8-811a-0631ce60240d tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 200 len: 1678 microversion: 2.1 time: 0.213024 Jul 28 05:35:26.937653 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 309/533] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:26 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 1678 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:35:27.090649 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-5aae3810-d476-423e-ad54-7be88e2311c4 req-acfcd43d-150c-4c83-9b00-6568d21c0379 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f769843b-cb4a-4599-bf54-49d579601a8a", "name": "network-vif-deleted", "tag": "b006268e-0b66-4d7e-8674-41ac5075555d"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:35:27.101684 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-5aae3810-d476-423e-ad54-7be88e2311c4 req-acfcd43d-150c-4c83-9b00-6568d21c0379 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:27.102284 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-5aae3810-d476-423e-ad54-7be88e2311c4 req-acfcd43d-150c-4c83-9b00-6568d21c0379 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:27.118281 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-5aae3810-d476-423e-ad54-7be88e2311c4 req-acfcd43d-150c-4c83-9b00-6568d21c0379 service nova] Creating event network-vif-deleted:b006268e-0b66-4d7e-8674-41ac5075555d for instance f769843b-cb4a-4599-bf54-49d579601a8a on hv-cinder-79987 Jul 28 05:35:27.121228 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-5aae3810-d476-423e-ad54-7be88e2311c4 req-acfcd43d-150c-4c83-9b00-6568d21c0379 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034066 Jul 28 05:35:27.125795 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 310/534] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:35:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:35:27.383520 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-ddb4fac2-984e-42c3-938d-6a500364cc24 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:27.384323 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-ddb4fac2-984e-42c3-938d-6a500364cc24 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:27.390982 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ddb4fac2-984e-42c3-938d-6a500364cc24 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:27.391513 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ddb4fac2-984e-42c3-938d-6a500364cc24 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:27.392888 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ddb4fac2-984e-42c3-938d-6a500364cc24 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:27.392888 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ddb4fac2-984e-42c3-938d-6a500364cc24 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:27.409327 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:35:27.532325 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-ddb4fac2-984e-42c3-938d-6a500364cc24 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:27.541050 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-ddb4fac2-984e-42c3-938d-6a500364cc24 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9" status: 200 len: 1723 microversion: 2.1 time: 0.162107 Jul 28 05:35:27.541547 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 311/535] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:27 2022] GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:35:27.577506 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-f57b3a98-8964-4e72-96bf-a24ea2e1508d tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:27.578226 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-f57b3a98-8964-4e72-96bf-a24ea2e1508d tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: f769843b-cb4a-4599-bf54-49d579601a8a] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:27.585225 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f57b3a98-8964-4e72-96bf-a24ea2e1508d tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:27.585704 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f57b3a98-8964-4e72-96bf-a24ea2e1508d tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:27.586467 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f57b3a98-8964-4e72-96bf-a24ea2e1508d tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:27.586895 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f57b3a98-8964-4e72-96bf-a24ea2e1508d tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:27.653641 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-f57b3a98-8964-4e72-96bf-a24ea2e1508d tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:27.658805 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-f57b3a98-8964-4e72-96bf-a24ea2e1508d tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a" status: 200 len: 1615 microversion: 2.1 time: 0.085231 Jul 28 05:35:27.659383 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 312/536] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:27 2022] GET /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a => generated 1615 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:35:27.959546 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-b92ba486-dd94-4ed2-89e3-ea65963b1fe8 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:27.960221 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-b92ba486-dd94-4ed2-89e3-ea65963b1fe8 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:27.968170 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b92ba486-dd94-4ed2-89e3-ea65963b1fe8 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:27.968700 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b92ba486-dd94-4ed2-89e3-ea65963b1fe8 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:27.969461 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b92ba486-dd94-4ed2-89e3-ea65963b1fe8 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:27.969980 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b92ba486-dd94-4ed2-89e3-ea65963b1fe8 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:28.115441 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-b92ba486-dd94-4ed2-89e3-ea65963b1fe8 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:28.124163 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-b92ba486-dd94-4ed2-89e3-ea65963b1fe8 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 200 len: 1678 microversion: 2.1 time: 0.168798 Jul 28 05:35:28.124884 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 313/537] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:27 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:35:28.563250 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-4d00e8ae-11b2-42ce-adb9-5081c4ab1302 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:28.563858 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-4d00e8ae-11b2-42ce-adb9-5081c4ab1302 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:28.569987 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4d00e8ae-11b2-42ce-adb9-5081c4ab1302 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:28.570435 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4d00e8ae-11b2-42ce-adb9-5081c4ab1302 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:28.571189 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4d00e8ae-11b2-42ce-adb9-5081c4ab1302 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:28.571625 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4d00e8ae-11b2-42ce-adb9-5081c4ab1302 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:28.704498 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-4d00e8ae-11b2-42ce-adb9-5081c4ab1302 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:28.712566 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-4d00e8ae-11b2-42ce-adb9-5081c4ab1302 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9" status: 200 len: 1729 microversion: 2.1 time: 0.153863 Jul 28 05:35:28.713139 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 314/538] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:28 2022] GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:35:28.717493 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-37a6ede9-0fde-4721-b274-5af690d2efb8 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:28.718093 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-37a6ede9-0fde-4721-b274-5af690d2efb8 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: f769843b-cb4a-4599-bf54-49d579601a8a] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:28.723746 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-37a6ede9-0fde-4721-b274-5af690d2efb8 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:28.724189 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-37a6ede9-0fde-4721-b274-5af690d2efb8 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:28.724935 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-37a6ede9-0fde-4721-b274-5af690d2efb8 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:28.725369 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-37a6ede9-0fde-4721-b274-5af690d2efb8 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:28.756150 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-37a6ede9-0fde-4721-b274-5af690d2efb8 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:28.756594 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-37a6ede9-0fde-4721-b274-5af690d2efb8 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:28.757032 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.objects.instance [None req-37a6ede9-0fde-4721-b274-5af690d2efb8 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lazy-loading 'fault' on Instance uuid f769843b-cb4a-4599-bf54-49d579601a8a {{(pid=124482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 05:35:28.797567 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-37a6ede9-0fde-4721-b274-5af690d2efb8 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:28.804878 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-37a6ede9-0fde-4721-b274-5af690d2efb8 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a" status: 200 len: 1332 microversion: 2.1 time: 0.090783 Jul 28 05:35:28.805441 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 315/539] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:28 2022] GET /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a => generated 1332 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:35:28.810644 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-e7490e75-9021-41ea-9cc9-a1abdfe1acd6 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:28.811133 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-e7490e75-9021-41ea-9cc9-a1abdfe1acd6 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:28.816751 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e7490e75-9021-41ea-9cc9-a1abdfe1acd6 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:28.817199 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e7490e75-9021-41ea-9cc9-a1abdfe1acd6 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:28.817985 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e7490e75-9021-41ea-9cc9-a1abdfe1acd6 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:28.818419 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e7490e75-9021-41ea-9cc9-a1abdfe1acd6 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:28.897934 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-e7490e75-9021-41ea-9cc9-a1abdfe1acd6 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091368 Jul 28 05:35:28.898536 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 316/540] 10.222.0.33 () {58 vars in 1275 bytes} [Thu Jul 28 05:35:28 2022] GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:35:29.145909 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-5fd4c32d-4fef-449d-ae15-7b773b7f0cef tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:29.146604 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-5fd4c32d-4fef-449d-ae15-7b773b7f0cef tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:29.152524 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5fd4c32d-4fef-449d-ae15-7b773b7f0cef tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:29.153073 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5fd4c32d-4fef-449d-ae15-7b773b7f0cef tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:29.154003 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5fd4c32d-4fef-449d-ae15-7b773b7f0cef tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:29.154438 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5fd4c32d-4fef-449d-ae15-7b773b7f0cef tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:29.400628 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-5fd4c32d-4fef-449d-ae15-7b773b7f0cef tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:29.408716 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-5fd4c32d-4fef-449d-ae15-7b773b7f0cef tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 200 len: 1678 microversion: 2.1 time: 0.267490 Jul 28 05:35:29.409290 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 317/541] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:29 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 1678 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:35:29.826938 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-e14fbda1-6bfe-46be-860e-1d0ec4bf76d5 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:29.828184 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-e14fbda1-6bfe-46be-860e-1d0ec4bf76d5 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: f769843b-cb4a-4599-bf54-49d579601a8a] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:29.834317 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e14fbda1-6bfe-46be-860e-1d0ec4bf76d5 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:29.834760 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e14fbda1-6bfe-46be-860e-1d0ec4bf76d5 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:29.835534 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e14fbda1-6bfe-46be-860e-1d0ec4bf76d5 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:29.835968 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e14fbda1-6bfe-46be-860e-1d0ec4bf76d5 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:29.867141 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e14fbda1-6bfe-46be-860e-1d0ec4bf76d5 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:29.867580 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e14fbda1-6bfe-46be-860e-1d0ec4bf76d5 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:29.868024 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.objects.instance [None req-e14fbda1-6bfe-46be-860e-1d0ec4bf76d5 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lazy-loading 'fault' on Instance uuid f769843b-cb4a-4599-bf54-49d579601a8a {{(pid=124482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 05:35:29.930134 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-e14fbda1-6bfe-46be-860e-1d0ec4bf76d5 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:29.937957 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-e14fbda1-6bfe-46be-860e-1d0ec4bf76d5 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a" status: 200 len: 1332 microversion: 2.1 time: 0.115373 Jul 28 05:35:29.938535 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 318/542] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:29 2022] GET /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a => generated 1332 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:35:30.135018 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-b97731e7-154e-4330-8400-617fe9796ab5 req-d9d46042-1e9f-4f93-bf06-92a7d308e48f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9", "tag": "1507aad5-e944-47e5-a8d9-716f5bde1fff"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:35:30.147156 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-b97731e7-154e-4330-8400-617fe9796ab5 req-d9d46042-1e9f-4f93-bf06-92a7d308e48f service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:30.147804 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-b97731e7-154e-4330-8400-617fe9796ab5 req-d9d46042-1e9f-4f93-bf06-92a7d308e48f service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:30.159328 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-b97731e7-154e-4330-8400-617fe9796ab5 req-d9d46042-1e9f-4f93-bf06-92a7d308e48f service nova] Creating event network-changed:1507aad5-e944-47e5-a8d9-716f5bde1fff for instance 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 on hv-cinder-79987 Jul 28 05:35:30.164996 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-b97731e7-154e-4330-8400-617fe9796ab5 req-d9d46042-1e9f-4f93-bf06-92a7d308e48f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033585 Jul 28 05:35:30.165808 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 319/543] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:35:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 05:35:30.431707 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-97de0912-e256-4d8e-bdeb-5b60e20f6605 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:30.432392 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-97de0912-e256-4d8e-bdeb-5b60e20f6605 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:30.439243 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-97de0912-e256-4d8e-bdeb-5b60e20f6605 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:30.439693 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-97de0912-e256-4d8e-bdeb-5b60e20f6605 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:30.440463 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-97de0912-e256-4d8e-bdeb-5b60e20f6605 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:30.440901 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-97de0912-e256-4d8e-bdeb-5b60e20f6605 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:30.574076 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-97de0912-e256-4d8e-bdeb-5b60e20f6605 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:30.583508 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-97de0912-e256-4d8e-bdeb-5b60e20f6605 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 200 len: 1678 microversion: 2.1 time: 0.156154 Jul 28 05:35:30.584090 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 320/544] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:30 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:35:30.959319 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-09a976f6-dede-4499-bdb4-7295689d9589 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:30.959922 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-09a976f6-dede-4499-bdb4-7295689d9589 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: f769843b-cb4a-4599-bf54-49d579601a8a] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:30.966255 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-09a976f6-dede-4499-bdb4-7295689d9589 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:30.966690 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-09a976f6-dede-4499-bdb4-7295689d9589 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:30.967466 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-09a976f6-dede-4499-bdb4-7295689d9589 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:30.967891 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-09a976f6-dede-4499-bdb4-7295689d9589 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:30.995364 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:35:30.999706 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-09a976f6-dede-4499-bdb4-7295689d9589 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:31.000143 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-09a976f6-dede-4499-bdb4-7295689d9589 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:31.000581 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.objects.instance [None req-09a976f6-dede-4499-bdb4-7295689d9589 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lazy-loading 'fault' on Instance uuid f769843b-cb4a-4599-bf54-49d579601a8a {{(pid=124482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 05:35:31.040777 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-09a976f6-dede-4499-bdb4-7295689d9589 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:31.050223 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-09a976f6-dede-4499-bdb4-7295689d9589 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a" status: 200 len: 1332 microversion: 2.1 time: 0.094703 Jul 28 05:35:31.050789 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 321/545] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:30 2022] GET /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a => generated 1332 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:35:31.606961 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-b3f3174f-d44e-4d15-b1a5-31951046ecee tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:31.607703 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-b3f3174f-d44e-4d15-b1a5-31951046ecee tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:31.614619 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b3f3174f-d44e-4d15-b1a5-31951046ecee tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:31.615151 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b3f3174f-d44e-4d15-b1a5-31951046ecee tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:31.616043 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b3f3174f-d44e-4d15-b1a5-31951046ecee tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:31.616515 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b3f3174f-d44e-4d15-b1a5-31951046ecee tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:31.841161 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-b3f3174f-d44e-4d15-b1a5-31951046ecee tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:31.849727 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-b3f3174f-d44e-4d15-b1a5-31951046ecee tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 200 len: 1678 microversion: 2.1 time: 0.247760 Jul 28 05:35:31.850352 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 322/546] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:31 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 1678 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:35:32.071848 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-9f266cc8-a2dd-4999-8d96-01ab2f552312 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:32.072447 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-9f266cc8-a2dd-4999-8d96-01ab2f552312 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: f769843b-cb4a-4599-bf54-49d579601a8a] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:32.079535 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9f266cc8-a2dd-4999-8d96-01ab2f552312 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:32.079972 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9f266cc8-a2dd-4999-8d96-01ab2f552312 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:32.080720 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9f266cc8-a2dd-4999-8d96-01ab2f552312 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:32.081172 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9f266cc8-a2dd-4999-8d96-01ab2f552312 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:32.095213 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.wsgi [None req-9f266cc8-a2dd-4999-8d96-01ab2f552312 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] HTTP exception thrown: Instance f769843b-cb4a-4599-bf54-49d579601a8a could not be found. Jul 28 05:35:32.096873 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-9f266cc8-a2dd-4999-8d96-01ab2f552312 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Request method failure captured: Jul 28 05:35:32.096873 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: request: GET /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a HTTP/1.1 Jul 28 05:35:32.096873 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept: application/json Jul 28 05:35:32.096873 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept-Encoding: identity Jul 28 05:35:32.096873 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Connection: close Jul 28 05:35:32.096873 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Length: 0 Jul 28 05:35:32.096873 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Type: application/json Jul 28 05:35:32.096873 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Host: 10.222.0.33 Jul 28 05:35:32.096873 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Openstack-System-Scope: None Jul 28 05:35:32.096873 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: User-Agent: python-urllib3/1.26.10 Jul 28 05:35:32.096873 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Auth-Token: gAAAAABi4h9D_G9i011T28yIc-ZNvejV_UpI0QoKlXE0FGZ91QFBkrT7qoFtXVHh-pu6aHMGmM56LTiBsS724USe_vuB1sVPXPQos6zopSWxHNIiTv0vnR9zJg55cl6dG7-t6mrt4b6a18Xfa5nEVVolwB-FkmudbFUJziZU1gufozNL3J-fAhg Jul 28 05:35:32.096873 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Id: None Jul 28 05:35:32.096873 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Name: None Jul 28 05:35:32.096873 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Identity-Status: Confirmed Jul 28 05:35:32.096873 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Is-Admin-Project: True Jul 28 05:35:32.096873 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Id: default Jul 28 05:35:32.096873 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Name: Default Jul 28 05:35:32.096873 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Id: ba0b7f7639504a25a73c94335d62b98f Jul 28 05:35:32.096873 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Name: tempest-AttachVolumeNegativeTest-1557602675 Jul 28 05:35:32.096873 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Role: member,reader Jul 28 05:35:32.096873 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Roles: member,reader Jul 28 05:35:32.098208 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ba0b7f7639504a25a73c94335d62b98f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ba0b7f7639504a25a73c94335d62b98f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ba0b7f7639504a25a73c94335d62b98f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ba0b7f7639504a25a73c94335d62b98f"}]}] Jul 28 05:35:32.098208 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant: tempest-AttachVolumeNegativeTest-1557602675 Jul 28 05:35:32.098208 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Id: ba0b7f7639504a25a73c94335d62b98f Jul 28 05:35:32.098208 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1557602675 Jul 28 05:35:32.098208 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User: tempest-AttachVolumeNegativeTest-1557602675-project Jul 28 05:35:32.098208 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Id: default Jul 28 05:35:32.098208 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Name: Default Jul 28 05:35:32.098208 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Id: 0002ebbc629b4dafb109dc94450fe1d8 Jul 28 05:35:32.098208 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Name: tempest-AttachVolumeNegativeTest-1557602675-project Jul 28 05:35:32.098208 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: method: > Jul 28 05:35:32.098208 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: exception: Instance f769843b-cb4a-4599-bf54-49d579601a8a could not be found. Jul 28 05:35:32.098208 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: action_args: {'id': 'f769843b-cb4a-4599-bf54-49d579601a8a'} Jul 28 05:35:32.098913 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 05:35:32.098913 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:35:32.098913 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 05:35:32.098913 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 05:35:32.098913 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 05:35:32.098913 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 05:35:32.098913 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 05:35:32.098913 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 05:35:32.098913 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 05:35:32.098913 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 05:35:32.098913 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f769843b-cb4a-4599-bf54-49d579601a8a could not be found. Jul 28 05:35:32.098913 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:35:32.098913 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:35:32.098913 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:35:32.098913 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:35:32.098913 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:35:32.098913 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:35:32.098913 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 05:35:32.098913 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 05:35:32.098913 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 05:35:32.100623 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:35:32.100623 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 05:35:32.100623 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 05:35:32.100623 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 05:35:32.100623 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 05:35:32.100623 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 05:35:32.100623 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 05:35:32.100623 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f769843b-cb4a-4599-bf54-49d579601a8a could not be found. Jul 28 05:35:32.100623 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:35:32.100623 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:35:32.100623 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:35:32.100623 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:35:32.100623 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:35:32.100623 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:35:32.100623 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 05:35:32.100623 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 05:35:32.100623 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f769843b-cb4a-4599-bf54-49d579601a8a could not be found. Jul 28 05:35:32.100623 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:35:32.102069 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-9f266cc8-a2dd-4999-8d96-01ab2f552312 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Returning 404 to user: Instance f769843b-cb4a-4599-bf54-49d579601a8a could not be found. {{(pid=124482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 05:35:32.102069 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-9f266cc8-a2dd-4999-8d96-01ab2f552312 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a" status: 404 len: 111 microversion: 2.1 time: 0.030331 Jul 28 05:35:32.102069 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 323/547] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:32 2022] GET /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 05:35:32.106874 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-3146f35d-e6da-4f06-8eb8-945cae53ef4b tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '.version_select at 0x7f25e035c3a0>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:32.178320 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-3146f35d-e6da-4f06-8eb8-945cae53ef4b tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2045500188" status: 202 len: 0 microversion: 2.1 time: 0.074993 Jul 28 05:35:32.178977 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 324/548] 10.222.0.33 () {58 vars in 1221 bytes} [Thu Jul 28 05:35:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2045500188 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 05:35:32.183491 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-4191d913-7783-4b3b-90ce-0c3ba2603fd9 req-ca2cdd9a-5f01-447b-8d82-632d833838a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9", "tag": "1507aad5-e944-47e5-a8d9-716f5bde1fff"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:35:32.194745 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-4191d913-7783-4b3b-90ce-0c3ba2603fd9 req-ca2cdd9a-5f01-447b-8d82-632d833838a7 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:32.195187 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-4191d913-7783-4b3b-90ce-0c3ba2603fd9 req-ca2cdd9a-5f01-447b-8d82-632d833838a7 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:32.206705 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-4191d913-7783-4b3b-90ce-0c3ba2603fd9 req-ca2cdd9a-5f01-447b-8d82-632d833838a7 service nova] Creating event network-changed:1507aad5-e944-47e5-a8d9-716f5bde1fff for instance 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 on hv-cinder-79987 Jul 28 05:35:32.211462 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-4191d913-7783-4b3b-90ce-0c3ba2603fd9 req-ca2cdd9a-5f01-447b-8d82-632d833838a7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031394 Jul 28 05:35:32.212058 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 325/549] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:35:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:35:32.872749 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-af6b060c-3763-41a9-9001-0d16e1acd86b tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:32.873414 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-af6b060c-3763-41a9-9001-0d16e1acd86b tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:32.879598 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-af6b060c-3763-41a9-9001-0d16e1acd86b tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:32.883638 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-af6b060c-3763-41a9-9001-0d16e1acd86b tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:32.883638 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-af6b060c-3763-41a9-9001-0d16e1acd86b tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:32.883638 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-af6b060c-3763-41a9-9001-0d16e1acd86b tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:33.024500 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-af6b060c-3763-41a9-9001-0d16e1acd86b tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:33.032357 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-af6b060c-3763-41a9-9001-0d16e1acd86b tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 200 len: 1655 microversion: 2.1 time: 0.165001 Jul 28 05:35:33.032965 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 326/550] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:32 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 1655 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:35:33.037660 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-23a57d8b-b4d4-4bd5-b195-8297da599fd9 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Action: 'create', calling method: .version_select at 0x7f25e02e6ee0>, body: {"keypair": {"name": "tempest-keypair-1694396167", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLS+n8G/C1Zh+4q9rKMbZIhMckuiTPy1tV2Q8r/S6Kus/6FYylqfZ2vlHoowg5KsvatkkS4l89z8p5XWkQVmREpaoJf2N4+NW14T+IZVhOYueTdJCVQJXKE9pqIXvIB5pw=="}} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:35:33.054267 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.quota [None req-23a57d8b-b4d4-4bd5-b195-8297da599fd9 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Getting quotas for project ba0b7f7639504a25a73c94335d62b98f. Resources: {'key_pairs'} {{(pid=124482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 05:35:33.058123 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.quota [None req-23a57d8b-b4d4-4bd5-b195-8297da599fd9 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Getting quotas for user 0002ebbc629b4dafb109dc94450fe1d8 and project ba0b7f7639504a25a73c94335d62b98f. Resources: {'key_pairs'} {{(pid=124482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 05:35:33.145343 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-23a57d8b-b4d4-4bd5-b195-8297da599fd9 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.111124 Jul 28 05:35:33.145978 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 327/551] 10.222.0.33 () {60 vars in 1159 bytes} [Thu Jul 28 05:35:33 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:35:33.150750 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-c4076b2d-6243-4ec5-986b-604f029e4970 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:35:33.157197 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c4076b2d-6243-4ec5-986b-604f029e4970 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:33.157645 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c4076b2d-6243-4ec5-986b-604f029e4970 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:33.182130 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-c4076b2d-6243-4ec5-986b-604f029e4970 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Going to try to start instance {{(pid=124482) start /opt/stack/nova/nova/compute/api.py:2733}} Jul 28 05:35:33.411227 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-c4076b2d-6243-4ec5-986b-604f029e4970 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "POST /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268/action" status: 202 len: 0 microversion: 2.1 time: 0.263322 Jul 28 05:35:33.414991 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 328/552] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Jul 28 05:35:33 2022] POST /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 05:35:33.420664 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-fb34399c-462d-4fe1-9df1-b3dbdbca49af tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:33.421395 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-fb34399c-462d-4fe1-9df1-b3dbdbca49af tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:33.427662 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-fb34399c-462d-4fe1-9df1-b3dbdbca49af tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:33.428114 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-fb34399c-462d-4fe1-9df1-b3dbdbca49af tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:33.428882 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-fb34399c-462d-4fe1-9df1-b3dbdbca49af tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:33.429339 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-fb34399c-462d-4fe1-9df1-b3dbdbca49af tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:33.566346 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-fb34399c-462d-4fe1-9df1-b3dbdbca49af tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:33.576157 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-fb34399c-462d-4fe1-9df1-b3dbdbca49af tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 200 len: 1664 microversion: 2.1 time: 0.159642 Jul 28 05:35:33.576843 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 329/553] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:33 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 1664 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:35:34.598858 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-a9dce8cd-1a06-4196-9f7c-015c1a709df8 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:34.599509 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-a9dce8cd-1a06-4196-9f7c-015c1a709df8 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:34.606712 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a9dce8cd-1a06-4196-9f7c-015c1a709df8 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:34.607149 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a9dce8cd-1a06-4196-9f7c-015c1a709df8 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:34.607895 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a9dce8cd-1a06-4196-9f7c-015c1a709df8 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:34.608322 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a9dce8cd-1a06-4196-9f7c-015c1a709df8 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:34.623305 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:35:34.749650 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-a9dce8cd-1a06-4196-9f7c-015c1a709df8 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:34.757925 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-a9dce8cd-1a06-4196-9f7c-015c1a709df8 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 200 len: 1664 microversion: 2.1 time: 0.163049 Jul 28 05:35:34.761047 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 330/554] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:34 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 1664 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:35:35.468278 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-99bfc7b2-bae7-49fd-99ca-212bee3298b7 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1884660825", "imageRef": "4f0ce061-6677-4c2a-9ee1-54a100f21462", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f094ee85-e5f7-4f76-b25b-19d66faa4449"}], "security_groups": [{"name": "tempest-securitygroup--1448221134"}], "key_name": "tempest-keypair-1694396167", "user_data": "}} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:35:35.577397 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.network.neutron [None req-99bfc7b2-bae7-49fd-99ca-212bee3298b7 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] validate_networks() for [('f094ee85-e5f7-4f76-b25b-19d66faa4449', None, None, None, None, None)] {{(pid=124482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 05:35:35.957068 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-99bfc7b2-bae7-49fd-99ca-212bee3298b7 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Flavor limits 0:0:0 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 05:35:35.957680 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-99bfc7b2-bae7-49fd-99ca-212bee3298b7 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Image limits 0:0:0 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 05:35:35.958479 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-99bfc7b2-bae7-49fd-99ca-212bee3298b7 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Flavor pref 0:0:0 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 05:35:35.958988 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-99bfc7b2-bae7-49fd-99ca-212bee3298b7 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Image pref 0:0:0 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 05:35:35.959461 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-99bfc7b2-bae7-49fd-99ca-212bee3298b7 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 05:35:35.968989 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-99bfc7b2-bae7-49fd-99ca-212bee3298b7 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:35.969925 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-99bfc7b2-bae7-49fd-99ca-212bee3298b7 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:35.970488 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-99bfc7b2-bae7-49fd-99ca-212bee3298b7 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:35.970918 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-99bfc7b2-bae7-49fd-99ca-212bee3298b7 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:35.988383 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.quota [None req-99bfc7b2-bae7-49fd-99ca-212bee3298b7 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Getting quotas for project ba0b7f7639504a25a73c94335d62b98f. Resources: {'ram', 'instances', 'cores'} {{(pid=124482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 05:35:35.992456 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.quota [None req-99bfc7b2-bae7-49fd-99ca-212bee3298b7 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Getting quotas for user 0002ebbc629b4dafb109dc94450fe1d8 and project ba0b7f7639504a25a73c94335d62b98f. Resources: {'ram', 'instances', 'cores'} {{(pid=124482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 05:35:36.003791 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-99bfc7b2-bae7-49fd-99ca-212bee3298b7 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Going to run 1 instances... {{(pid=124482) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 05:35:36.006100 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-99bfc7b2-bae7-49fd-99ca-212bee3298b7 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: b9162e60-7996-4d4d-964f-6844383357b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f0ce061-6677-4c2a-9ee1-54a100f21462',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 05:35:36.238764 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-99bfc7b2-bae7-49fd-99ca-212bee3298b7 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.775696 Jul 28 05:35:36.239334 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 331/555] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Jul 28 05:35:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 777 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 05:35:36.243961 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-a6686102-dd99-4cb0-82a3-3c56c82a0173 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:36.244610 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-a6686102-dd99-4cb0-82a3-3c56c82a0173 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:36.251799 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a6686102-dd99-4cb0-82a3-3c56c82a0173 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:36.252240 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a6686102-dd99-4cb0-82a3-3c56c82a0173 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:36.252994 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a6686102-dd99-4cb0-82a3-3c56c82a0173 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:36.253651 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a6686102-dd99-4cb0-82a3-3c56c82a0173 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:36.390569 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-a6686102-dd99-4cb0-82a3-3c56c82a0173 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:36.399336 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-a6686102-dd99-4cb0-82a3-3c56c82a0173 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 200 len: 1668 microversion: 2.1 time: 0.158871 Jul 28 05:35:36.400104 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 332/556] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:36 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 1668 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:35:36.405242 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-d2d00e4b-1414-411f-b434-20e0594e95c0 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:36.405986 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-d2d00e4b-1414-411f-b434-20e0594e95c0 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: b9162e60-7996-4d4d-964f-6844383357b6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:36.472236 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-d2d00e4b-1414-411f-b434-20e0594e95c0 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:36.481500 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-d2d00e4b-1414-411f-b434-20e0594e95c0 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/b9162e60-7996-4d4d-964f-6844383357b6" status: 200 len: 1242 microversion: 2.1 time: 0.079807 Jul 28 05:35:36.482178 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 333/557] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:36 2022] GET /compute/v2.1/servers/b9162e60-7996-4d4d-964f-6844383357b6 => generated 1242 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:35:37.502153 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-e7e45294-591b-48e5-9b35-3b9883357be3 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:37.502827 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-e7e45294-591b-48e5-9b35-3b9883357be3 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: b9162e60-7996-4d4d-964f-6844383357b6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:37.509020 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e7e45294-591b-48e5-9b35-3b9883357be3 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:37.511070 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e7e45294-591b-48e5-9b35-3b9883357be3 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:37.511070 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e7e45294-591b-48e5-9b35-3b9883357be3 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:37.511070 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e7e45294-591b-48e5-9b35-3b9883357be3 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:37.586789 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-e7e45294-591b-48e5-9b35-3b9883357be3 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:37.592677 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-e7e45294-591b-48e5-9b35-3b9883357be3 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/b9162e60-7996-4d4d-964f-6844383357b6" status: 200 len: 1238 microversion: 2.1 time: 0.094387 Jul 28 05:35:37.593279 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 334/558] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:37 2022] GET /compute/v2.1/servers/b9162e60-7996-4d4d-964f-6844383357b6 => generated 1238 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:35:38.613762 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-56fdabf7-ac48-4227-981a-5d0f0d17d6a5 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:38.614400 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-56fdabf7-ac48-4227-981a-5d0f0d17d6a5 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: b9162e60-7996-4d4d-964f-6844383357b6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:38.620785 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-56fdabf7-ac48-4227-981a-5d0f0d17d6a5 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:38.621863 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-56fdabf7-ac48-4227-981a-5d0f0d17d6a5 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:38.622635 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-56fdabf7-ac48-4227-981a-5d0f0d17d6a5 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:38.623067 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-56fdabf7-ac48-4227-981a-5d0f0d17d6a5 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:38.683420 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-56fdabf7-ac48-4227-981a-5d0f0d17d6a5 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:38.691468 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-56fdabf7-ac48-4227-981a-5d0f0d17d6a5 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/b9162e60-7996-4d4d-964f-6844383357b6" status: 200 len: 1302 microversion: 2.1 time: 0.081618 Jul 28 05:35:38.692037 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 335/559] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:38 2022] GET /compute/v2.1/servers/b9162e60-7996-4d4d-964f-6844383357b6 => generated 1302 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:35:39.712430 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-5e13a7ad-8d39-42bf-b716-0dc0832152c7 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:39.713049 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-5e13a7ad-8d39-42bf-b716-0dc0832152c7 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: b9162e60-7996-4d4d-964f-6844383357b6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:39.720467 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5e13a7ad-8d39-42bf-b716-0dc0832152c7 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:39.720910 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5e13a7ad-8d39-42bf-b716-0dc0832152c7 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:39.721703 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5e13a7ad-8d39-42bf-b716-0dc0832152c7 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:39.722145 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5e13a7ad-8d39-42bf-b716-0dc0832152c7 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:39.782885 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-5e13a7ad-8d39-42bf-b716-0dc0832152c7 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:39.790232 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-5e13a7ad-8d39-42bf-b716-0dc0832152c7 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/b9162e60-7996-4d4d-964f-6844383357b6" status: 200 len: 1302 microversion: 2.1 time: 0.081703 Jul 28 05:35:39.790792 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 336/560] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:39 2022] GET /compute/v2.1/servers/b9162e60-7996-4d4d-964f-6844383357b6 => generated 1302 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:35:40.811287 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-152b355c-3baa-4bab-a35b-c4651106baea tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:40.811896 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-152b355c-3baa-4bab-a35b-c4651106baea tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: b9162e60-7996-4d4d-964f-6844383357b6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:40.818468 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-152b355c-3baa-4bab-a35b-c4651106baea tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:40.818918 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-152b355c-3baa-4bab-a35b-c4651106baea tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:40.819675 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-152b355c-3baa-4bab-a35b-c4651106baea tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:40.820112 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-152b355c-3baa-4bab-a35b-c4651106baea tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:40.883454 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-152b355c-3baa-4bab-a35b-c4651106baea tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:40.891516 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-152b355c-3baa-4bab-a35b-c4651106baea tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/b9162e60-7996-4d4d-964f-6844383357b6" status: 200 len: 1302 microversion: 2.1 time: 0.084803 Jul 28 05:35:40.892088 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 337/561] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:40 2022] GET /compute/v2.1/servers/b9162e60-7996-4d4d-964f-6844383357b6 => generated 1302 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:35:41.912215 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-0c6b0a15-8450-460a-ad11-902345ae8f6d tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:41.912920 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-0c6b0a15-8450-460a-ad11-902345ae8f6d tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: b9162e60-7996-4d4d-964f-6844383357b6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:41.920312 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-0c6b0a15-8450-460a-ad11-902345ae8f6d tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:41.925347 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-0c6b0a15-8450-460a-ad11-902345ae8f6d tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:41.925347 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-0c6b0a15-8450-460a-ad11-902345ae8f6d tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:41.925347 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-0c6b0a15-8450-460a-ad11-902345ae8f6d tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:42.181915 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-0c6b0a15-8450-460a-ad11-902345ae8f6d tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:42.190054 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-0c6b0a15-8450-460a-ad11-902345ae8f6d tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/b9162e60-7996-4d4d-964f-6844383357b6" status: 200 len: 1368 microversion: 2.1 time: 0.281597 Jul 28 05:35:42.204533 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 338/562] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:41 2022] GET /compute/v2.1/servers/b9162e60-7996-4d4d-964f-6844383357b6 => generated 1368 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:35:42.729710 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-fbc29732-54bb-4a4d-8e1c-6fc6dc4edc17 req-ab4d92de-8f52-4007-b4f3-97bc39e9e306 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9162e60-7996-4d4d-964f-6844383357b6", "tag": "30d872c4-2287-4532-9e34-e113896ad3a6"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:35:42.744758 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-fbc29732-54bb-4a4d-8e1c-6fc6dc4edc17 req-ab4d92de-8f52-4007-b4f3-97bc39e9e306 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:42.745212 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-fbc29732-54bb-4a4d-8e1c-6fc6dc4edc17 req-ab4d92de-8f52-4007-b4f3-97bc39e9e306 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:42.761266 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-fbc29732-54bb-4a4d-8e1c-6fc6dc4edc17 req-ab4d92de-8f52-4007-b4f3-97bc39e9e306 service nova] Creating event network-changed:30d872c4-2287-4532-9e34-e113896ad3a6 for instance b9162e60-7996-4d4d-964f-6844383357b6 on hv-cinder-79987 Jul 28 05:35:42.766799 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-fbc29732-54bb-4a4d-8e1c-6fc6dc4edc17 req-ab4d92de-8f52-4007-b4f3-97bc39e9e306 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040780 Jul 28 05:35:42.767685 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 339/563] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:35:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 05:35:43.212765 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-582eee51-81b8-49a9-b70c-6375c061b50d tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:43.213487 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-582eee51-81b8-49a9-b70c-6375c061b50d tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: b9162e60-7996-4d4d-964f-6844383357b6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:43.220477 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-582eee51-81b8-49a9-b70c-6375c061b50d tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:43.220951 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-582eee51-81b8-49a9-b70c-6375c061b50d tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:43.221758 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-582eee51-81b8-49a9-b70c-6375c061b50d tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:43.222197 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-582eee51-81b8-49a9-b70c-6375c061b50d tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:43.672771 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-582eee51-81b8-49a9-b70c-6375c061b50d tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:43.681156 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-582eee51-81b8-49a9-b70c-6375c061b50d tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/b9162e60-7996-4d4d-964f-6844383357b6" status: 200 len: 1368 microversion: 2.1 time: 0.473101 Jul 28 05:35:43.682472 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 340/564] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:43 2022] GET /compute/v2.1/servers/b9162e60-7996-4d4d-964f-6844383357b6 => generated 1368 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:35:44.701929 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-87071fda-3011-4e42-b877-272d6c2c81c1 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:44.702603 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-87071fda-3011-4e42-b877-272d6c2c81c1 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: b9162e60-7996-4d4d-964f-6844383357b6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:44.709035 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-87071fda-3011-4e42-b877-272d6c2c81c1 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:44.709487 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-87071fda-3011-4e42-b877-272d6c2c81c1 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:44.710257 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-87071fda-3011-4e42-b877-272d6c2c81c1 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:44.710691 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-87071fda-3011-4e42-b877-272d6c2c81c1 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:44.841775 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-87071fda-3011-4e42-b877-272d6c2c81c1 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:44.849196 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-87071fda-3011-4e42-b877-272d6c2c81c1 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/b9162e60-7996-4d4d-964f-6844383357b6" status: 200 len: 1368 microversion: 2.1 time: 0.151136 Jul 28 05:35:44.849816 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 341/565] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:44 2022] GET /compute/v2.1/servers/b9162e60-7996-4d4d-964f-6844383357b6 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:35:45.870507 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-a3a9cc2f-4e5f-4421-be56-f30c8bceba64 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:45.871765 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-a3a9cc2f-4e5f-4421-be56-f30c8bceba64 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: b9162e60-7996-4d4d-964f-6844383357b6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:45.878032 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a3a9cc2f-4e5f-4421-be56-f30c8bceba64 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:45.878472 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a3a9cc2f-4e5f-4421-be56-f30c8bceba64 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:45.879213 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a3a9cc2f-4e5f-4421-be56-f30c8bceba64 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:45.879639 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a3a9cc2f-4e5f-4421-be56-f30c8bceba64 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:45.979016 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell0:SELECT=2 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:35:46.007186 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-a3a9cc2f-4e5f-4421-be56-f30c8bceba64 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:46.015190 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-a3a9cc2f-4e5f-4421-be56-f30c8bceba64 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/b9162e60-7996-4d4d-964f-6844383357b6" status: 200 len: 1368 microversion: 2.1 time: 0.148532 Jul 28 05:35:46.015755 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 342/566] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:45 2022] GET /compute/v2.1/servers/b9162e60-7996-4d4d-964f-6844383357b6 => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:35:46.945005 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-1ca51047-856d-4f22-b12b-37d97c65be42 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:46.945703 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-1ca51047-856d-4f22-b12b-37d97c65be42 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:46.947615 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell0:SELECT=12 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:35:46.953838 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1ca51047-856d-4f22-b12b-37d97c65be42 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:46.954322 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1ca51047-856d-4f22-b12b-37d97c65be42 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:46.955085 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1ca51047-856d-4f22-b12b-37d97c65be42 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:46.955548 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1ca51047-856d-4f22-b12b-37d97c65be42 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:46.985016 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-1ca51047-856d-4f22-b12b-37d97c65be42 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5/os-volume_attachments/5dcabdf7-8a8e-4c7d-9f9c-954aff561df1" status: 200 len: 194 microversion: 2.20 time: 0.044142 Jul 28 05:35:46.985702 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 343/567] 10.222.0.33 () {60 vars in 1454 bytes} [Thu Jul 28 05:35:46 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5/os-volume_attachments/5dcabdf7-8a8e-4c7d-9f9c-954aff561df1 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 05:35:47.036455 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-c82c34b7-eed8-4ebc-a22c-b8064d2332b8 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:47.037057 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-c82c34b7-eed8-4ebc-a22c-b8064d2332b8 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: b9162e60-7996-4d4d-964f-6844383357b6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:47.043658 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c82c34b7-eed8-4ebc-a22c-b8064d2332b8 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:47.048844 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c82c34b7-eed8-4ebc-a22c-b8064d2332b8 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:47.048844 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c82c34b7-eed8-4ebc-a22c-b8064d2332b8 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:47.048844 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c82c34b7-eed8-4ebc-a22c-b8064d2332b8 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:47.180853 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-c82c34b7-eed8-4ebc-a22c-b8064d2332b8 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:47.188766 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-c82c34b7-eed8-4ebc-a22c-b8064d2332b8 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/b9162e60-7996-4d4d-964f-6844383357b6" status: 200 len: 1368 microversion: 2.1 time: 0.156536 Jul 28 05:35:47.189335 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 344/568] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:47 2022] GET /compute/v2.1/servers/b9162e60-7996-4d4d-964f-6844383357b6 => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:35:47.197838 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-625361f5-1ea4-4dfa-a6cc-13c5b03b165b tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:47.197838 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-625361f5-1ea4-4dfa-a6cc-13c5b03b165b tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:47.200737 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-625361f5-1ea4-4dfa-a6cc-13c5b03b165b tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:47.201181 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-625361f5-1ea4-4dfa-a6cc-13c5b03b165b tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:47.201955 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-625361f5-1ea4-4dfa-a6cc-13c5b03b165b tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:47.202387 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-625361f5-1ea4-4dfa-a6cc-13c5b03b165b tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:47.281498 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.objects.instance [None req-625361f5-1ea4-4dfa-a6cc-13c5b03b165b tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lazy-loading 'services' on Instance uuid 57115a26-af82-499e-a831-4b4c40e60ac5 {{(pid=124482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 05:35:47.462659 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-625361f5-1ea4-4dfa-a6cc-13c5b03b165b tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "DELETE /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5/os-volume_attachments/5dcabdf7-8a8e-4c7d-9f9c-954aff561df1" status: 202 len: 0 microversion: 2.20 time: 0.271977 Jul 28 05:35:47.463509 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 345/569] 10.222.0.33 () {60 vars in 1457 bytes} [Thu Jul 28 05:35:47 2022] DELETE /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5/os-volume_attachments/5dcabdf7-8a8e-4c7d-9f9c-954aff561df1 => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 05:35:47.471719 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-1f0b79cf-d2ef-43d4-bbb3-b14db4447833 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:47.474163 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-1f0b79cf-d2ef-43d4-bbb3-b14db4447833 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:47.483351 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1f0b79cf-d2ef-43d4-bbb3-b14db4447833 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:47.483784 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1f0b79cf-d2ef-43d4-bbb3-b14db4447833 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:47.484558 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1f0b79cf-d2ef-43d4-bbb3-b14db4447833 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:47.484988 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1f0b79cf-d2ef-43d4-bbb3-b14db4447833 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:47.523647 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-1f0b79cf-d2ef-43d4-bbb3-b14db4447833 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051031 Jul 28 05:35:47.523647 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 346/570] 10.222.0.33 () {60 vars in 1343 bytes} [Thu Jul 28 05:35:47 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 05:35:48.211820 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-870f6dc8-615c-424d-a9c3-e1b082e463a1 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:48.212504 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-870f6dc8-615c-424d-a9c3-e1b082e463a1 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: b9162e60-7996-4d4d-964f-6844383357b6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:48.219643 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-870f6dc8-615c-424d-a9c3-e1b082e463a1 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:48.220095 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-870f6dc8-615c-424d-a9c3-e1b082e463a1 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:48.220857 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-870f6dc8-615c-424d-a9c3-e1b082e463a1 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:48.221295 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-870f6dc8-615c-424d-a9c3-e1b082e463a1 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:48.356292 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-870f6dc8-615c-424d-a9c3-e1b082e463a1 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:48.363773 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-870f6dc8-615c-424d-a9c3-e1b082e463a1 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/b9162e60-7996-4d4d-964f-6844383357b6" status: 200 len: 1368 microversion: 2.1 time: 0.155881 Jul 28 05:35:48.364346 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 347/571] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:48 2022] GET /compute/v2.1/servers/b9162e60-7996-4d4d-964f-6844383357b6 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:35:48.535248 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-1f999ee2-a787-4310-a125-f11d9260bf11 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:48.540352 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-1f999ee2-a787-4310-a125-f11d9260bf11 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:48.543551 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1f999ee2-a787-4310-a125-f11d9260bf11 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:48.544043 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1f999ee2-a787-4310-a125-f11d9260bf11 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:48.544819 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1f999ee2-a787-4310-a125-f11d9260bf11 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:48.545252 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1f999ee2-a787-4310-a125-f11d9260bf11 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:48.572357 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:35:48.577374 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-1f999ee2-a787-4310-a125-f11d9260bf11 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046180 Jul 28 05:35:48.577985 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 348/572] 10.222.0.33 () {60 vars in 1343 bytes} [Thu Jul 28 05:35:48 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 05:35:48.667466 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-68beb6af-4b8c-440d-a86a-0276afc3980a req-d92325df-9f22-48be-bc45-60fdc87de244 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9162e60-7996-4d4d-964f-6844383357b6", "name": "network-vif-plugged", "status": "completed", "tag": "30d872c4-2287-4532-9e34-e113896ad3a6"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:35:48.676844 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-68beb6af-4b8c-440d-a86a-0276afc3980a req-d92325df-9f22-48be-bc45-60fdc87de244 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:48.677295 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-68beb6af-4b8c-440d-a86a-0276afc3980a req-d92325df-9f22-48be-bc45-60fdc87de244 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:48.688797 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-68beb6af-4b8c-440d-a86a-0276afc3980a req-d92325df-9f22-48be-bc45-60fdc87de244 service nova] Creating event network-vif-plugged:30d872c4-2287-4532-9e34-e113896ad3a6 for instance b9162e60-7996-4d4d-964f-6844383357b6 on hv-cinder-79987 Jul 28 05:35:48.693797 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-68beb6af-4b8c-440d-a86a-0276afc3980a req-d92325df-9f22-48be-bc45-60fdc87de244 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029935 Jul 28 05:35:48.694386 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 349/573] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:35:49.386324 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-51727328-95f4-415a-9fa7-65a072e1921c tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:49.387893 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-51727328-95f4-415a-9fa7-65a072e1921c tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: b9162e60-7996-4d4d-964f-6844383357b6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:49.394227 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-51727328-95f4-415a-9fa7-65a072e1921c tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:49.394733 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-51727328-95f4-415a-9fa7-65a072e1921c tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:49.395756 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-51727328-95f4-415a-9fa7-65a072e1921c tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:49.396193 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-51727328-95f4-415a-9fa7-65a072e1921c tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:49.530211 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-51727328-95f4-415a-9fa7-65a072e1921c tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:49.537708 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-51727328-95f4-415a-9fa7-65a072e1921c tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/b9162e60-7996-4d4d-964f-6844383357b6" status: 200 len: 1368 microversion: 2.1 time: 0.156672 Jul 28 05:35:49.538283 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 350/574] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:49 2022] GET /compute/v2.1/servers/b9162e60-7996-4d4d-964f-6844383357b6 => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:35:49.589563 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-ff0e45dd-86f6-4b07-b38e-469e2f8b42d4 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:49.591698 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-ff0e45dd-86f6-4b07-b38e-469e2f8b42d4 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:49.597681 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ff0e45dd-86f6-4b07-b38e-469e2f8b42d4 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:49.598128 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ff0e45dd-86f6-4b07-b38e-469e2f8b42d4 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:49.598879 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ff0e45dd-86f6-4b07-b38e-469e2f8b42d4 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:49.599310 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ff0e45dd-86f6-4b07-b38e-469e2f8b42d4 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:49.628224 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-ff0e45dd-86f6-4b07-b38e-469e2f8b42d4 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042491 Jul 28 05:35:49.628769 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 351/575] 10.222.0.33 () {60 vars in 1343 bytes} [Thu Jul 28 05:35:49 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:35:49.689365 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-95bdeb3b-97fd-499f-b67c-00575108a910 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:49.689889 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-95bdeb3b-97fd-499f-b67c-00575108a910 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:49.695864 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-95bdeb3b-97fd-499f-b67c-00575108a910 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:49.696311 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-95bdeb3b-97fd-499f-b67c-00575108a910 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:49.697064 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-95bdeb3b-97fd-499f-b67c-00575108a910 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:49.697512 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-95bdeb3b-97fd-499f-b67c-00575108a910 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:49.721743 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-95bdeb3b-97fd-499f-b67c-00575108a910 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Going to try to terminate instance {{(pid=124482) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 05:35:50.018197 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-95bdeb3b-97fd-499f-b67c-00575108a910 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "DELETE /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 204 len: 0 microversion: 2.20 time: 0.332372 Jul 28 05:35:50.018848 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 352/576] 10.222.0.33 () {60 vars in 1280 bytes} [Thu Jul 28 05:35:49 2022] DELETE /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 28 05:35:50.029306 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-b8d8939c-c1f2-406c-803e-5519640321cb tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:50.030050 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-b8d8939c-c1f2-406c-803e-5519640321cb tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:50.031946 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:35:50.037798 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b8d8939c-c1f2-406c-803e-5519640321cb tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:50.038542 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b8d8939c-c1f2-406c-803e-5519640321cb tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:50.039486 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b8d8939c-c1f2-406c-803e-5519640321cb tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:50.039942 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b8d8939c-c1f2-406c-803e-5519640321cb tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:50.178379 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-b8d8939c-c1f2-406c-803e-5519640321cb tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:50.187119 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-b8d8939c-c1f2-406c-803e-5519640321cb tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:50.188655 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-b8d8939c-c1f2-406c-803e-5519640321cb tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:50.190017 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-b8d8939c-c1f2-406c-803e-5519640321cb tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1722 microversion: 2.20 time: 0.165569 Jul 28 05:35:50.194975 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 353/577] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:35:50 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 05:35:50.559475 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-f9179708-75ea-4c75-aba8-1c10594ed2fc tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:50.560104 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-f9179708-75ea-4c75-aba8-1c10594ed2fc tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: b9162e60-7996-4d4d-964f-6844383357b6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:50.566942 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f9179708-75ea-4c75-aba8-1c10594ed2fc tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:50.571680 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f9179708-75ea-4c75-aba8-1c10594ed2fc tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:50.571680 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f9179708-75ea-4c75-aba8-1c10594ed2fc tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:50.571680 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f9179708-75ea-4c75-aba8-1c10594ed2fc tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:50.699926 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-f9179708-75ea-4c75-aba8-1c10594ed2fc tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:50.707394 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-f9179708-75ea-4c75-aba8-1c10594ed2fc tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/b9162e60-7996-4d4d-964f-6844383357b6" status: 200 len: 1368 microversion: 2.1 time: 0.152746 Jul 28 05:35:50.708889 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 354/578] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:50 2022] GET /compute/v2.1/servers/b9162e60-7996-4d4d-964f-6844383357b6 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:35:51.217463 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-f5cf6751-35c9-416e-ae96-93486991fcb6 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:51.217989 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-f5cf6751-35c9-416e-ae96-93486991fcb6 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:51.223966 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f5cf6751-35c9-416e-ae96-93486991fcb6 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:51.224411 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f5cf6751-35c9-416e-ae96-93486991fcb6 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:51.225159 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f5cf6751-35c9-416e-ae96-93486991fcb6 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:51.225622 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f5cf6751-35c9-416e-ae96-93486991fcb6 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:51.356259 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-f5cf6751-35c9-416e-ae96-93486991fcb6 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:51.364127 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-f5cf6751-35c9-416e-ae96-93486991fcb6 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:51.365651 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-f5cf6751-35c9-416e-ae96-93486991fcb6 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:51.366812 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-f5cf6751-35c9-416e-ae96-93486991fcb6 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1722 microversion: 2.20 time: 0.153994 Jul 28 05:35:51.367368 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 355/579] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:35:51 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 05:35:51.728869 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-add976c9-905c-483b-afc3-0fd2bb8b5095 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:51.729527 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-add976c9-905c-483b-afc3-0fd2bb8b5095 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: b9162e60-7996-4d4d-964f-6844383357b6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:51.736781 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-add976c9-905c-483b-afc3-0fd2bb8b5095 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:51.737233 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-add976c9-905c-483b-afc3-0fd2bb8b5095 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:51.738021 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-add976c9-905c-483b-afc3-0fd2bb8b5095 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:51.738463 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-add976c9-905c-483b-afc3-0fd2bb8b5095 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:51.868198 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-add976c9-905c-483b-afc3-0fd2bb8b5095 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:51.875867 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-add976c9-905c-483b-afc3-0fd2bb8b5095 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/b9162e60-7996-4d4d-964f-6844383357b6" status: 200 len: 1368 microversion: 2.1 time: 0.150860 Jul 28 05:35:51.876436 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 356/580] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:51 2022] GET /compute/v2.1/servers/b9162e60-7996-4d4d-964f-6844383357b6 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:35:52.389671 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-074a77db-38ae-4ba0-b392-33da8948551f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:52.390888 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-074a77db-38ae-4ba0-b392-33da8948551f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:52.397412 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-074a77db-38ae-4ba0-b392-33da8948551f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:52.397871 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-074a77db-38ae-4ba0-b392-33da8948551f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:52.398630 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-074a77db-38ae-4ba0-b392-33da8948551f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:52.399065 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-074a77db-38ae-4ba0-b392-33da8948551f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:52.530340 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-074a77db-38ae-4ba0-b392-33da8948551f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:52.538302 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-074a77db-38ae-4ba0-b392-33da8948551f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:52.540326 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-074a77db-38ae-4ba0-b392-33da8948551f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:52.541512 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-074a77db-38ae-4ba0-b392-33da8948551f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1722 microversion: 2.20 time: 0.155857 Jul 28 05:35:52.542088 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 357/581] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:35:52 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 05:35:52.897527 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-05fced55-9154-45aa-980c-a1621ac9e3ce tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:52.898263 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-05fced55-9154-45aa-980c-a1621ac9e3ce tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: b9162e60-7996-4d4d-964f-6844383357b6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:52.906287 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-05fced55-9154-45aa-980c-a1621ac9e3ce tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:52.906753 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-05fced55-9154-45aa-980c-a1621ac9e3ce tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:52.911190 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-05fced55-9154-45aa-980c-a1621ac9e3ce tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:52.911190 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-05fced55-9154-45aa-980c-a1621ac9e3ce tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:53.108786 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-05fced55-9154-45aa-980c-a1621ac9e3ce tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:53.115693 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-05fced55-9154-45aa-980c-a1621ac9e3ce tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/b9162e60-7996-4d4d-964f-6844383357b6" status: 200 len: 1559 microversion: 2.1 time: 0.222376 Jul 28 05:35:53.116363 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 358/582] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:52 2022] GET /compute/v2.1/servers/b9162e60-7996-4d4d-964f-6844383357b6 => generated 1559 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:35:53.137809 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-6f1c69e8-54a5-40c1-ba13-30e667ccc114 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:53.138779 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-6f1c69e8-54a5-40c1-ba13-30e667ccc114 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: b9162e60-7996-4d4d-964f-6844383357b6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:53.145184 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-6f1c69e8-54a5-40c1-ba13-30e667ccc114 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:53.146542 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-6f1c69e8-54a5-40c1-ba13-30e667ccc114 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:53.147343 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-6f1c69e8-54a5-40c1-ba13-30e667ccc114 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:53.147781 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-6f1c69e8-54a5-40c1-ba13-30e667ccc114 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:53.225582 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-6f1c69e8-54a5-40c1-ba13-30e667ccc114 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/b9162e60-7996-4d4d-964f-6844383357b6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092295 Jul 28 05:35:53.226348 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 359/583] 10.222.0.33 () {58 vars in 1275 bytes} [Thu Jul 28 05:35:53 2022] GET /compute/v2.1/servers/b9162e60-7996-4d4d-964f-6844383357b6/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 05:35:53.566039 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-12675757-ff02-4b86-87de-3cd0b50bc01f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:53.566703 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-12675757-ff02-4b86-87de-3cd0b50bc01f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:53.573064 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-12675757-ff02-4b86-87de-3cd0b50bc01f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:53.573527 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-12675757-ff02-4b86-87de-3cd0b50bc01f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:53.574285 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-12675757-ff02-4b86-87de-3cd0b50bc01f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:53.575479 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-12675757-ff02-4b86-87de-3cd0b50bc01f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:53.678443 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-12675757-ff02-4b86-87de-3cd0b50bc01f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:53.693116 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-12675757-ff02-4b86-87de-3cd0b50bc01f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:53.696183 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-12675757-ff02-4b86-87de-3cd0b50bc01f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:53.697985 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-12675757-ff02-4b86-87de-3cd0b50bc01f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1655 microversion: 2.20 time: 0.136330 Jul 28 05:35:53.712941 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 360/584] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:35:53 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1655 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 05:35:53.919267 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-43fbcbc5-104d-4398-a7ae-7b6032b87e28 req-7dd6c0df-ade7-40d8-a969-6266b88569cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57115a26-af82-499e-a831-4b4c40e60ac5", "name": "network-vif-deleted", "tag": "968687ce-4c57-4729-84c6-548124c4123e"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:35:53.931144 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-43fbcbc5-104d-4398-a7ae-7b6032b87e28 req-7dd6c0df-ade7-40d8-a969-6266b88569cb service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:53.931603 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-43fbcbc5-104d-4398-a7ae-7b6032b87e28 req-7dd6c0df-ade7-40d8-a969-6266b88569cb service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:53.944354 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-43fbcbc5-104d-4398-a7ae-7b6032b87e28 req-7dd6c0df-ade7-40d8-a969-6266b88569cb service nova] Creating event network-vif-deleted:968687ce-4c57-4729-84c6-548124c4123e for instance 57115a26-af82-499e-a831-4b4c40e60ac5 on hv-cinder-79987 Jul 28 05:35:53.949231 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-43fbcbc5-104d-4398-a7ae-7b6032b87e28 req-7dd6c0df-ade7-40d8-a969-6266b88569cb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035555 Jul 28 05:35:53.950293 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 361/585] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:35:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 05:35:54.727172 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-b828a7a2-b73e-4b73-85ad-40b5bf580fea tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:54.727871 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-b828a7a2-b73e-4b73-85ad-40b5bf580fea tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:54.734890 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b828a7a2-b73e-4b73-85ad-40b5bf580fea tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:54.735342 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b828a7a2-b73e-4b73-85ad-40b5bf580fea tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:54.736193 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b828a7a2-b73e-4b73-85ad-40b5bf580fea tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:54.736627 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b828a7a2-b73e-4b73-85ad-40b5bf580fea tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:54.776285 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b828a7a2-b73e-4b73-85ad-40b5bf580fea tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:54.777203 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b828a7a2-b73e-4b73-85ad-40b5bf580fea tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:54.779376 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.objects.instance [None req-b828a7a2-b73e-4b73-85ad-40b5bf580fea tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lazy-loading 'fault' on Instance uuid 57115a26-af82-499e-a831-4b4c40e60ac5 {{(pid=124482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 05:35:54.835025 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-b828a7a2-b73e-4b73-85ad-40b5bf580fea tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:54.845143 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-b828a7a2-b73e-4b73-85ad-40b5bf580fea tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:54.848269 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-b828a7a2-b73e-4b73-85ad-40b5bf580fea tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:54.848269 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-b828a7a2-b73e-4b73-85ad-40b5bf580fea tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 200 len: 1371 microversion: 2.20 time: 0.125594 Jul 28 05:35:54.848991 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 362/586] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:35:54 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 1371 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 05:35:55.873647 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-c8edfa03-c825-4021-8fba-24c1aff2774a tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:55.874629 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-c8edfa03-c825-4021-8fba-24c1aff2774a tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:55.881663 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c8edfa03-c825-4021-8fba-24c1aff2774a tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:55.885863 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c8edfa03-c825-4021-8fba-24c1aff2774a tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:55.885863 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c8edfa03-c825-4021-8fba-24c1aff2774a tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:55.885863 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c8edfa03-c825-4021-8fba-24c1aff2774a tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:55.898752 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.wsgi [None req-c8edfa03-c825-4021-8fba-24c1aff2774a tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] HTTP exception thrown: Instance 57115a26-af82-499e-a831-4b4c40e60ac5 could not be found. Jul 28 05:35:55.900529 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-c8edfa03-c825-4021-8fba-24c1aff2774a tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Request method failure captured: Jul 28 05:35:55.900529 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: request: GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 HTTP/1.1 Jul 28 05:35:55.900529 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept: application/json Jul 28 05:35:55.900529 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept-Encoding: identity Jul 28 05:35:55.900529 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Connection: close Jul 28 05:35:55.900529 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Length: 0 Jul 28 05:35:55.900529 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Type: application/json Jul 28 05:35:55.900529 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Host: 10.222.0.33 Jul 28 05:35:55.900529 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Openstack-System-Scope: None Jul 28 05:35:55.900529 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: User-Agent: python-urllib3/1.26.10 Jul 28 05:35:55.900529 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Auth-Token: gAAAAABi4h9B4BZ0YKk62IEiK2B7fNXnAEvmUzwRuX3HZAwpyBQuwrelM32kVXxMwMHFWRpIiF0wrQELj7IIFkWW2dNQ1l6hVjctg_7QgVgoHpLuzx0PaLQ7DgaTnloBovVfWeMHK4qw8EQUGTonIgEEe8nVn-xX6wXcJIqTwy53KhNB8eAmkus Jul 28 05:35:55.900529 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Id: None Jul 28 05:35:55.900529 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Name: None Jul 28 05:35:55.900529 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Identity-Status: Confirmed Jul 28 05:35:55.900529 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Is-Admin-Project: True Jul 28 05:35:55.900529 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 05:35:55.900529 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Id: default Jul 28 05:35:55.900529 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Name: Default Jul 28 05:35:55.900529 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Id: d6e54a77d2aa469b8c0197d99170d978 Jul 28 05:35:55.900529 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-524079106 Jul 28 05:35:55.900529 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Role: member,reader Jul 28 05:35:55.900529 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Roles: member,reader Jul 28 05:35:55.902068 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d6e54a77d2aa469b8c0197d99170d978"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d6e54a77d2aa469b8c0197d99170d978"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d6e54a77d2aa469b8c0197d99170d978", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d6e54a77d2aa469b8c0197d99170d978"}]}] Jul 28 05:35:55.902068 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant: tempest-AttachVolumeShelveTestJSON-524079106 Jul 28 05:35:55.902068 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Id: d6e54a77d2aa469b8c0197d99170d978 Jul 28 05:35:55.902068 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-524079106 Jul 28 05:35:55.902068 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User: tempest-AttachVolumeShelveTestJSON-524079106-project Jul 28 05:35:55.902068 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Id: default Jul 28 05:35:55.902068 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Name: Default Jul 28 05:35:55.902068 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Id: 22fddcc9952a459899e48a93d1d962db Jul 28 05:35:55.902068 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Name: tempest-AttachVolumeShelveTestJSON-524079106-project Jul 28 05:35:55.902068 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: method: > Jul 28 05:35:55.902068 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: exception: Instance 57115a26-af82-499e-a831-4b4c40e60ac5 could not be found. Jul 28 05:35:55.902068 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: action_args: {'id': '57115a26-af82-499e-a831-4b4c40e60ac5'} Jul 28 05:35:55.902853 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 05:35:55.902853 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:35:55.902853 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 05:35:55.902853 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 05:35:55.902853 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 05:35:55.902853 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 05:35:55.902853 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 05:35:55.902853 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 05:35:55.902853 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 05:35:55.902853 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 05:35:55.902853 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57115a26-af82-499e-a831-4b4c40e60ac5 could not be found. Jul 28 05:35:55.902853 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:35:55.902853 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:35:55.902853 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:35:55.902853 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:35:55.902853 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:35:55.902853 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:35:55.902853 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 05:35:55.902853 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 05:35:55.902853 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 05:35:55.904059 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:35:55.904059 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 05:35:55.904059 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 05:35:55.904059 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 05:35:55.904059 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 05:35:55.904059 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 05:35:55.904059 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 05:35:55.904059 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57115a26-af82-499e-a831-4b4c40e60ac5 could not be found. Jul 28 05:35:55.904059 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:35:55.904059 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:35:55.904059 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:35:55.904059 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:35:55.904059 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:35:55.904059 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:35:55.904059 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 05:35:55.904059 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 05:35:55.904059 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57115a26-af82-499e-a831-4b4c40e60ac5 could not be found. Jul 28 05:35:55.904059 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:35:55.905331 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-c8edfa03-c825-4021-8fba-24c1aff2774a tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Returning 404 to user: Instance 57115a26-af82-499e-a831-4b4c40e60ac5 could not be found. {{(pid=124482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 05:35:55.905331 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-c8edfa03-c825-4021-8fba-24c1aff2774a tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 404 len: 111 microversion: 2.20 time: 0.033966 Jul 28 05:35:55.906147 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 363/587] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:35:55 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 28 05:35:55.911063 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-e1265301-e19e-4c73-9864-f0353ba19a00 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '.version_select at 0x7f25e02eb820>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:55.991312 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-e1265301-e19e-4c73-9864-f0353ba19a00 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1162946105" status: 204 len: 0 microversion: 2.20 time: 0.083963 Jul 28 05:35:55.991926 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 364/588] 10.222.0.33 () {60 vars in 1262 bytes} [Thu Jul 28 05:35:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1162946105 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 05:35:55.997338 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-fedfce63-6bd0-4828-9202-466d99ba1542 req-2c7cc619-715e-465c-99c2-8d61c0675bc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9162e60-7996-4d4d-964f-6844383357b6", "tag": "30d872c4-2287-4532-9e34-e113896ad3a6"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:35:56.007817 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-fedfce63-6bd0-4828-9202-466d99ba1542 req-2c7cc619-715e-465c-99c2-8d61c0675bc1 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:56.008264 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-fedfce63-6bd0-4828-9202-466d99ba1542 req-2c7cc619-715e-465c-99c2-8d61c0675bc1 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:56.019389 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-fedfce63-6bd0-4828-9202-466d99ba1542 req-2c7cc619-715e-465c-99c2-8d61c0675bc1 service nova] Creating event network-changed:30d872c4-2287-4532-9e34-e113896ad3a6 for instance b9162e60-7996-4d4d-964f-6844383357b6 on hv-cinder-79987 Jul 28 05:35:56.024703 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-fedfce63-6bd0-4828-9202-466d99ba1542 req-2c7cc619-715e-465c-99c2-8d61c0675bc1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031659 Jul 28 05:35:56.025298 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 365/589] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:35:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:35:56.758464 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-474903cf-2ec3-4ea9-8690-6ad21b5f15c2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Action: 'create', calling method: .version_select at 0x7f25e03bb040>, body: {"keypair": {"name": "tempest-keypair-867176790", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPS+Ac42+1SZYe0tSw3Wa5oX2TPbEeC/Cq/Rd9Xvgt1FiQ4nczXYy/rWSxM6u+Vx4vU87elTsRmWw121QM3Kkn40BKBbjEEpK29582bjGc2Q9zh61ozFfBD6ZT7WASVP6A=="}} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:35:56.774901 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.quota [None req-474903cf-2ec3-4ea9-8690-6ad21b5f15c2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Getting quotas for project d6e54a77d2aa469b8c0197d99170d978. Resources: {'key_pairs'} {{(pid=124482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 05:35:56.779588 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.quota [None req-474903cf-2ec3-4ea9-8690-6ad21b5f15c2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Getting quotas for user 22fddcc9952a459899e48a93d1d962db and project d6e54a77d2aa469b8c0197d99170d978. Resources: {'key_pairs'} {{(pid=124482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 05:35:56.889028 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-474903cf-2ec3-4ea9-8690-6ad21b5f15c2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.134793 Jul 28 05:35:56.889716 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 366/590] 10.222.0.33 () {62 vars in 1200 bytes} [Thu Jul 28 05:35:56 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 136 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 28 05:35:56.894513 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-76cc860d-42ed-455e-baac-6c7959bd2fa5 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:56.895615 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-76cc860d-42ed-455e-baac-6c7959bd2fa5 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] [instance: 76337f4b-add0-4221-8712-c9d29a9c459e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:56.903047 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-76cc860d-42ed-455e-baac-6c7959bd2fa5 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:56.903508 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-76cc860d-42ed-455e-baac-6c7959bd2fa5 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:56.904285 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-76cc860d-42ed-455e-baac-6c7959bd2fa5 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:56.904725 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-76cc860d-42ed-455e-baac-6c7959bd2fa5 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:57.081287 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-76cc860d-42ed-455e-baac-6c7959bd2fa5 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3310483e0e64521999dfcafec143f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce7104e69fe4e15b070558784aa40d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:57.089144 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-76cc860d-42ed-455e-baac-6c7959bd2fa5 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] 10.222.0.33 "GET /compute/v2.1/servers/76337f4b-add0-4221-8712-c9d29a9c459e" status: 200 len: 1496 microversion: 2.1 time: 0.198461 Jul 28 05:35:57.089818 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 367/591] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:35:56 2022] GET /compute/v2.1/servers/76337f4b-add0-4221-8712-c9d29a9c459e => generated 1496 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:35:59.141617 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-a2ee943b-e1aa-43bb-8ff4-4d426f993003 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1400745588", "imageRef": "4f0ce061-6677-4c2a-9ee1-54a100f21462", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "12676c2f-cd93-405a-a402-b0ee7cfa77c5"}], "security_groups": [{"name": "tempest-securitygroup--1817828024"}], "key_name": "tempest-keypair-867176790", "user_data": "}} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:35:59.243173 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.network.neutron [None req-a2ee943b-e1aa-43bb-8ff4-4d426f993003 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] validate_networks() for [('12676c2f-cd93-405a-a402-b0ee7cfa77c5', None, None, None, None, None)] {{(pid=124482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 05:35:59.607790 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-a2ee943b-e1aa-43bb-8ff4-4d426f993003 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Flavor limits 0:0:0 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 05:35:59.608203 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-a2ee943b-e1aa-43bb-8ff4-4d426f993003 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Image limits 0:0:0 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 05:35:59.608669 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-a2ee943b-e1aa-43bb-8ff4-4d426f993003 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Flavor pref 0:0:0 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 05:35:59.609118 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-a2ee943b-e1aa-43bb-8ff4-4d426f993003 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Image pref 0:0:0 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 05:35:59.609544 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-a2ee943b-e1aa-43bb-8ff4-4d426f993003 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 05:35:59.618263 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a2ee943b-e1aa-43bb-8ff4-4d426f993003 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:59.618700 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a2ee943b-e1aa-43bb-8ff4-4d426f993003 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:59.619480 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a2ee943b-e1aa-43bb-8ff4-4d426f993003 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:35:59.619907 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a2ee943b-e1aa-43bb-8ff4-4d426f993003 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:35:59.636443 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.quota [None req-a2ee943b-e1aa-43bb-8ff4-4d426f993003 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Getting quotas for project d6e54a77d2aa469b8c0197d99170d978. Resources: {'ram', 'instances', 'cores'} {{(pid=124482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 05:35:59.640407 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.quota [None req-a2ee943b-e1aa-43bb-8ff4-4d426f993003 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Getting quotas for user 22fddcc9952a459899e48a93d1d962db and project d6e54a77d2aa469b8c0197d99170d978. Resources: {'ram', 'instances', 'cores'} {{(pid=124482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 05:35:59.651156 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-a2ee943b-e1aa-43bb-8ff4-4d426f993003 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Going to run 1 instances... {{(pid=124482) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 05:35:59.653683 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-a2ee943b-e1aa-43bb-8ff4-4d426f993003 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f0ce061-6677-4c2a-9ee1-54a100f21462',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 05:35:59.769038 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-a2ee943b-e1aa-43bb-8ff4-4d426f993003 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.632143 Jul 28 05:35:59.769738 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 368/592] 10.222.0.33 () {62 vars in 1188 bytes} [Thu Jul 28 05:35:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 634 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 28 05:35:59.781353 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-14d02662-5786-4be7-8245-70441f5f1c4e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:35:59.782045 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-14d02662-5786-4be7-8245-70441f5f1c4e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:35:59.834817 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-14d02662-5786-4be7-8245-70441f5f1c4e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:59.843473 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-14d02662-5786-4be7-8245-70441f5f1c4e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:59.844992 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-14d02662-5786-4be7-8245-70441f5f1c4e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:35:59.846111 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-14d02662-5786-4be7-8245-70441f5f1c4e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 200 len: 1281 microversion: 2.20 time: 0.069196 Jul 28 05:35:59.846712 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 369/593] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:35:59 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 1281 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:36:00.868146 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-78283603-cd60-42d4-9fe4-cfa73c4f000d tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:00.868786 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-78283603-cd60-42d4-9fe4-cfa73c4f000d tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:00.876249 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-78283603-cd60-42d4-9fe4-cfa73c4f000d tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:00.876699 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-78283603-cd60-42d4-9fe4-cfa73c4f000d tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:00.877478 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-78283603-cd60-42d4-9fe4-cfa73c4f000d tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:00.877972 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-78283603-cd60-42d4-9fe4-cfa73c4f000d tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:00.880715 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:36:00.943118 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-78283603-cd60-42d4-9fe4-cfa73c4f000d tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:00.952716 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-78283603-cd60-42d4-9fe4-cfa73c4f000d tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:00.958103 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-78283603-cd60-42d4-9fe4-cfa73c4f000d tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:00.958103 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-78283603-cd60-42d4-9fe4-cfa73c4f000d tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 200 len: 1277 microversion: 2.20 time: 0.091160 Jul 28 05:36:00.958103 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 370/594] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:36:00 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 1277 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 05:36:00.960364 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-49f3f4a7-7566-45b1-b910-afda822a9c1f tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:00.960977 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-49f3f4a7-7566-45b1-b910-afda822a9c1f tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] [instance: 76337f4b-add0-4221-8712-c9d29a9c459e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:00.967047 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-49f3f4a7-7566-45b1-b910-afda822a9c1f tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:00.967496 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-49f3f4a7-7566-45b1-b910-afda822a9c1f tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:00.968255 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-49f3f4a7-7566-45b1-b910-afda822a9c1f tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:00.968689 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-49f3f4a7-7566-45b1-b910-afda822a9c1f tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:00.994115 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-49f3f4a7-7566-45b1-b910-afda822a9c1f tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] [instance: 76337f4b-add0-4221-8712-c9d29a9c459e] Going to try to terminate instance {{(pid=124482) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 05:36:01.286846 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-49f3f4a7-7566-45b1-b910-afda822a9c1f tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] 10.222.0.33 "DELETE /compute/v2.1/servers/76337f4b-add0-4221-8712-c9d29a9c459e" status: 204 len: 0 microversion: 2.1 time: 0.329705 Jul 28 05:36:01.287437 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 371/595] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Jul 28 05:36:00 2022] DELETE /compute/v2.1/servers/76337f4b-add0-4221-8712-c9d29a9c459e => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 05:36:01.298204 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-a2b1f63e-6959-4300-9f8d-99df11dfe795 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:01.298912 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-a2b1f63e-6959-4300-9f8d-99df11dfe795 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] [instance: 76337f4b-add0-4221-8712-c9d29a9c459e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:01.312261 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a2b1f63e-6959-4300-9f8d-99df11dfe795 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:01.312902 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a2b1f63e-6959-4300-9f8d-99df11dfe795 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:01.313739 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a2b1f63e-6959-4300-9f8d-99df11dfe795 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:01.314379 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a2b1f63e-6959-4300-9f8d-99df11dfe795 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:01.463468 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-a2b1f63e-6959-4300-9f8d-99df11dfe795 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3310483e0e64521999dfcafec143f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce7104e69fe4e15b070558784aa40d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:01.471761 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-a2b1f63e-6959-4300-9f8d-99df11dfe795 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] 10.222.0.33 "GET /compute/v2.1/servers/76337f4b-add0-4221-8712-c9d29a9c459e" status: 200 len: 1502 microversion: 2.1 time: 0.178643 Jul 28 05:36:01.472325 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 372/596] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:36:01 2022] GET /compute/v2.1/servers/76337f4b-add0-4221-8712-c9d29a9c459e => generated 1502 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:36:01.978515 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-32846ca0-0074-49c4-af86-b9251bf77b41 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:01.979128 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-32846ca0-0074-49c4-af86-b9251bf77b41 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:01.986324 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-32846ca0-0074-49c4-af86-b9251bf77b41 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:01.986774 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-32846ca0-0074-49c4-af86-b9251bf77b41 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:01.987567 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-32846ca0-0074-49c4-af86-b9251bf77b41 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:01.988006 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-32846ca0-0074-49c4-af86-b9251bf77b41 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:02.050167 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-32846ca0-0074-49c4-af86-b9251bf77b41 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:02.058154 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-32846ca0-0074-49c4-af86-b9251bf77b41 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:02.060342 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-32846ca0-0074-49c4-af86-b9251bf77b41 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:02.061523 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-32846ca0-0074-49c4-af86-b9251bf77b41 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 200 len: 1341 microversion: 2.20 time: 0.086920 Jul 28 05:36:02.062091 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 373/597] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:36:01 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 1341 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 05:36:02.497998 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-2e5a6fe2-ce13-4528-9789-960d703c6d47 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:02.498605 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-2e5a6fe2-ce13-4528-9789-960d703c6d47 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] [instance: 76337f4b-add0-4221-8712-c9d29a9c459e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:02.504545 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2e5a6fe2-ce13-4528-9789-960d703c6d47 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:02.504986 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2e5a6fe2-ce13-4528-9789-960d703c6d47 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:02.505768 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2e5a6fe2-ce13-4528-9789-960d703c6d47 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:02.506202 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2e5a6fe2-ce13-4528-9789-960d703c6d47 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:02.633090 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-2e5a6fe2-ce13-4528-9789-960d703c6d47 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3310483e0e64521999dfcafec143f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce7104e69fe4e15b070558784aa40d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:02.641006 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-2e5a6fe2-ce13-4528-9789-960d703c6d47 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] 10.222.0.33 "GET /compute/v2.1/servers/76337f4b-add0-4221-8712-c9d29a9c459e" status: 200 len: 1502 microversion: 2.1 time: 0.146930 Jul 28 05:36:02.641595 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 374/598] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:36:02 2022] GET /compute/v2.1/servers/76337f4b-add0-4221-8712-c9d29a9c459e => generated 1502 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:36:03.089776 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-f1a09ea5-df39-47ea-b0c3-5e1bbe9cf715 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:03.090442 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-f1a09ea5-df39-47ea-b0c3-5e1bbe9cf715 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:03.097032 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f1a09ea5-df39-47ea-b0c3-5e1bbe9cf715 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:03.097497 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f1a09ea5-df39-47ea-b0c3-5e1bbe9cf715 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:03.098286 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f1a09ea5-df39-47ea-b0c3-5e1bbe9cf715 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:03.098723 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f1a09ea5-df39-47ea-b0c3-5e1bbe9cf715 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:03.163405 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-f1a09ea5-df39-47ea-b0c3-5e1bbe9cf715 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:03.172136 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-f1a09ea5-df39-47ea-b0c3-5e1bbe9cf715 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:03.173693 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-f1a09ea5-df39-47ea-b0c3-5e1bbe9cf715 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:03.174798 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-f1a09ea5-df39-47ea-b0c3-5e1bbe9cf715 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 200 len: 1341 microversion: 2.20 time: 0.088946 Jul 28 05:36:03.175364 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 375/599] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:36:03 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 1341 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 05:36:03.662659 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-561c5735-821d-4ef7-a6b6-f2745a59ddc7 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:03.663183 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-561c5735-821d-4ef7-a6b6-f2745a59ddc7 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] [instance: 76337f4b-add0-4221-8712-c9d29a9c459e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:03.670148 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-561c5735-821d-4ef7-a6b6-f2745a59ddc7 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:03.670591 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-561c5735-821d-4ef7-a6b6-f2745a59ddc7 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:03.671342 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-561c5735-821d-4ef7-a6b6-f2745a59ddc7 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:03.671776 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-561c5735-821d-4ef7-a6b6-f2745a59ddc7 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:03.797457 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-561c5735-821d-4ef7-a6b6-f2745a59ddc7 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3310483e0e64521999dfcafec143f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce7104e69fe4e15b070558784aa40d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:03.805199 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-561c5735-821d-4ef7-a6b6-f2745a59ddc7 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] 10.222.0.33 "GET /compute/v2.1/servers/76337f4b-add0-4221-8712-c9d29a9c459e" status: 200 len: 1502 microversion: 2.1 time: 0.146402 Jul 28 05:36:03.805802 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 376/600] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:36:03 2022] GET /compute/v2.1/servers/76337f4b-add0-4221-8712-c9d29a9c459e => generated 1502 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:36:04.197705 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-474fb756-ac1d-46c7-8c59-1988cc1ac029 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:04.198322 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-474fb756-ac1d-46c7-8c59-1988cc1ac029 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:04.205045 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-474fb756-ac1d-46c7-8c59-1988cc1ac029 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:04.205524 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-474fb756-ac1d-46c7-8c59-1988cc1ac029 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:04.206292 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-474fb756-ac1d-46c7-8c59-1988cc1ac029 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:04.206729 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-474fb756-ac1d-46c7-8c59-1988cc1ac029 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:04.267250 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-474fb756-ac1d-46c7-8c59-1988cc1ac029 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:04.275439 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-474fb756-ac1d-46c7-8c59-1988cc1ac029 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:04.276962 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-474fb756-ac1d-46c7-8c59-1988cc1ac029 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:04.278093 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-474fb756-ac1d-46c7-8c59-1988cc1ac029 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 200 len: 1341 microversion: 2.20 time: 0.084406 Jul 28 05:36:04.279463 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 377/601] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:36:04 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 1341 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 05:36:04.827503 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-88247442-322c-4529-bd0f-74e0a765ded9 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:04.828183 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-88247442-322c-4529-bd0f-74e0a765ded9 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] [instance: 76337f4b-add0-4221-8712-c9d29a9c459e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:04.835899 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-88247442-322c-4529-bd0f-74e0a765ded9 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:04.836440 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-88247442-322c-4529-bd0f-74e0a765ded9 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:04.837285 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-88247442-322c-4529-bd0f-74e0a765ded9 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:04.837828 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-88247442-322c-4529-bd0f-74e0a765ded9 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:04.973537 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-88247442-322c-4529-bd0f-74e0a765ded9 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3310483e0e64521999dfcafec143f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce7104e69fe4e15b070558784aa40d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:04.982286 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-88247442-322c-4529-bd0f-74e0a765ded9 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] 10.222.0.33 "GET /compute/v2.1/servers/76337f4b-add0-4221-8712-c9d29a9c459e" status: 200 len: 1502 microversion: 2.1 time: 0.159243 Jul 28 05:36:04.983331 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 378/602] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:36:04 2022] GET /compute/v2.1/servers/76337f4b-add0-4221-8712-c9d29a9c459e => generated 1502 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:36:05.301980 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-5bafa4f0-74a1-4e85-acb9-b3a32bcbd60e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:05.303476 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-5bafa4f0-74a1-4e85-acb9-b3a32bcbd60e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:05.315965 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5bafa4f0-74a1-4e85-acb9-b3a32bcbd60e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:05.316430 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5bafa4f0-74a1-4e85-acb9-b3a32bcbd60e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:05.317520 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5bafa4f0-74a1-4e85-acb9-b3a32bcbd60e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:05.317969 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5bafa4f0-74a1-4e85-acb9-b3a32bcbd60e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:05.399907 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-5bafa4f0-74a1-4e85-acb9-b3a32bcbd60e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:05.419771 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-5bafa4f0-74a1-4e85-acb9-b3a32bcbd60e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:05.420964 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-5bafa4f0-74a1-4e85-acb9-b3a32bcbd60e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:05.422157 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-5bafa4f0-74a1-4e85-acb9-b3a32bcbd60e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 200 len: 1341 microversion: 2.20 time: 0.124619 Jul 28 05:36:05.422732 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 379/603] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:36:05 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 1341 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 05:36:05.892926 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-629e1e57-88a1-4093-abd4-86233480506e req-c5706cfc-f120-4d47-966e-fbd503bd3fbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76337f4b-add0-4221-8712-c9d29a9c459e", "name": "network-vif-deleted", "tag": "8ebaf053-9d65-45e3-b15e-dd2dc4a17cce"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:36:05.903226 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-629e1e57-88a1-4093-abd4-86233480506e req-c5706cfc-f120-4d47-966e-fbd503bd3fbe service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:05.903751 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-629e1e57-88a1-4093-abd4-86233480506e req-c5706cfc-f120-4d47-966e-fbd503bd3fbe service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:05.914926 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-629e1e57-88a1-4093-abd4-86233480506e req-c5706cfc-f120-4d47-966e-fbd503bd3fbe service nova] Creating event network-vif-deleted:8ebaf053-9d65-45e3-b15e-dd2dc4a17cce for instance 76337f4b-add0-4221-8712-c9d29a9c459e on hv-cinder-79987 Jul 28 05:36:05.919787 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-629e1e57-88a1-4093-abd4-86233480506e req-c5706cfc-f120-4d47-966e-fbd503bd3fbe service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031990 Jul 28 05:36:05.924825 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 380/604] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:36:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 05:36:06.004670 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-d5ba6ff1-6ed2-4802-b510-cbaa3aa66825 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:06.005368 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-d5ba6ff1-6ed2-4802-b510-cbaa3aa66825 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] [instance: 76337f4b-add0-4221-8712-c9d29a9c459e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:06.013539 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d5ba6ff1-6ed2-4802-b510-cbaa3aa66825 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:06.014032 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d5ba6ff1-6ed2-4802-b510-cbaa3aa66825 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:06.014835 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d5ba6ff1-6ed2-4802-b510-cbaa3aa66825 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:06.015337 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d5ba6ff1-6ed2-4802-b510-cbaa3aa66825 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:06.105990 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-d5ba6ff1-6ed2-4802-b510-cbaa3aa66825 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3310483e0e64521999dfcafec143f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce7104e69fe4e15b070558784aa40d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:06.116340 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-d5ba6ff1-6ed2-4802-b510-cbaa3aa66825 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] 10.222.0.33 "GET /compute/v2.1/servers/76337f4b-add0-4221-8712-c9d29a9c459e" status: 200 len: 1298 microversion: 2.1 time: 0.115926 Jul 28 05:36:06.121011 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 381/605] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:36:05 2022] GET /compute/v2.1/servers/76337f4b-add0-4221-8712-c9d29a9c459e => generated 1298 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:36:06.444799 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-982ee8ef-8a6d-4c92-87c0-6223333e3809 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:06.445462 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-982ee8ef-8a6d-4c92-87c0-6223333e3809 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:06.452614 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-982ee8ef-8a6d-4c92-87c0-6223333e3809 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:06.453066 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-982ee8ef-8a6d-4c92-87c0-6223333e3809 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:06.453864 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-982ee8ef-8a6d-4c92-87c0-6223333e3809 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:06.454294 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-982ee8ef-8a6d-4c92-87c0-6223333e3809 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:06.676018 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-982ee8ef-8a6d-4c92-87c0-6223333e3809 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:06.684218 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-982ee8ef-8a6d-4c92-87c0-6223333e3809 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:06.685796 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-982ee8ef-8a6d-4c92-87c0-6223333e3809 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:06.686920 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-982ee8ef-8a6d-4c92-87c0-6223333e3809 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 200 len: 1407 microversion: 2.20 time: 0.246185 Jul 28 05:36:06.687732 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 382/606] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:36:06 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 1407 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:36:07.141538 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-4668231b-3f0b-435d-a159-4f4669875b68 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:07.142187 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-4668231b-3f0b-435d-a159-4f4669875b68 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] [instance: 76337f4b-add0-4221-8712-c9d29a9c459e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:07.148968 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4668231b-3f0b-435d-a159-4f4669875b68 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:07.149416 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4668231b-3f0b-435d-a159-4f4669875b68 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:07.150226 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4668231b-3f0b-435d-a159-4f4669875b68 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:07.150752 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4668231b-3f0b-435d-a159-4f4669875b68 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:07.178699 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:36:07.182248 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4668231b-3f0b-435d-a159-4f4669875b68 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:07.182697 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4668231b-3f0b-435d-a159-4f4669875b68 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:07.183137 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.objects.instance [None req-4668231b-3f0b-435d-a159-4f4669875b68 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lazy-loading 'fault' on Instance uuid 76337f4b-add0-4221-8712-c9d29a9c459e {{(pid=124482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 05:36:07.269167 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-4668231b-3f0b-435d-a159-4f4669875b68 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3310483e0e64521999dfcafec143f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce7104e69fe4e15b070558784aa40d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:07.281252 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-4668231b-3f0b-435d-a159-4f4669875b68 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] 10.222.0.33 "GET /compute/v2.1/servers/76337f4b-add0-4221-8712-c9d29a9c459e" status: 200 len: 1303 microversion: 2.1 time: 0.143605 Jul 28 05:36:07.284270 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 383/607] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:36:07 2022] GET /compute/v2.1/servers/76337f4b-add0-4221-8712-c9d29a9c459e => generated 1303 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:36:07.286830 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-0a9207e7-764d-460c-b338-54885711b76e req-f5b10535-4561-47e8-bc06-bc561cc9268f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54986322-1272-4f12-a108-b8675f3190a6", "tag": "bb48c226-cd8a-426b-8392-6dcb3d411b85"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:36:07.298811 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-0a9207e7-764d-460c-b338-54885711b76e req-f5b10535-4561-47e8-bc06-bc561cc9268f service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:07.299295 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-0a9207e7-764d-460c-b338-54885711b76e req-f5b10535-4561-47e8-bc06-bc561cc9268f service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:07.311911 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-0a9207e7-764d-460c-b338-54885711b76e req-f5b10535-4561-47e8-bc06-bc561cc9268f service nova] Creating event network-changed:bb48c226-cd8a-426b-8392-6dcb3d411b85 for instance 54986322-1272-4f12-a108-b8675f3190a6 on hv-cinder-79987 Jul 28 05:36:07.316902 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-0a9207e7-764d-460c-b338-54885711b76e req-f5b10535-4561-47e8-bc06-bc561cc9268f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033801 Jul 28 05:36:07.317521 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 384/608] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:36:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:36:07.710286 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-25568aa0-d586-4bb3-bf5b-fc39c6895f12 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:07.710984 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-25568aa0-d586-4bb3-bf5b-fc39c6895f12 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:07.717790 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-25568aa0-d586-4bb3-bf5b-fc39c6895f12 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:07.718236 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-25568aa0-d586-4bb3-bf5b-fc39c6895f12 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:07.718996 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-25568aa0-d586-4bb3-bf5b-fc39c6895f12 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:07.719432 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-25568aa0-d586-4bb3-bf5b-fc39c6895f12 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:07.849636 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-25568aa0-d586-4bb3-bf5b-fc39c6895f12 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:07.858155 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-25568aa0-d586-4bb3-bf5b-fc39c6895f12 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:07.859762 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-25568aa0-d586-4bb3-bf5b-fc39c6895f12 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:07.860864 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-25568aa0-d586-4bb3-bf5b-fc39c6895f12 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 200 len: 1407 microversion: 2.20 time: 0.154815 Jul 28 05:36:07.861462 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 385/609] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:36:07 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 05:36:08.302969 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-28dc265a-10d9-4e25-90d9-d4eb19eadb79 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:08.303572 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-28dc265a-10d9-4e25-90d9-d4eb19eadb79 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] [instance: 76337f4b-add0-4221-8712-c9d29a9c459e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:08.310005 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-28dc265a-10d9-4e25-90d9-d4eb19eadb79 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:08.310444 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-28dc265a-10d9-4e25-90d9-d4eb19eadb79 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:08.311191 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-28dc265a-10d9-4e25-90d9-d4eb19eadb79 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:08.311621 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-28dc265a-10d9-4e25-90d9-d4eb19eadb79 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:08.314247 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:36:08.342876 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-28dc265a-10d9-4e25-90d9-d4eb19eadb79 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:08.343245 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-28dc265a-10d9-4e25-90d9-d4eb19eadb79 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:08.343678 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.objects.instance [None req-28dc265a-10d9-4e25-90d9-d4eb19eadb79 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lazy-loading 'fault' on Instance uuid 76337f4b-add0-4221-8712-c9d29a9c459e {{(pid=124482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 05:36:08.384528 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-28dc265a-10d9-4e25-90d9-d4eb19eadb79 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3310483e0e64521999dfcafec143f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce7104e69fe4e15b070558784aa40d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:08.392072 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-28dc265a-10d9-4e25-90d9-d4eb19eadb79 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] 10.222.0.33 "GET /compute/v2.1/servers/76337f4b-add0-4221-8712-c9d29a9c459e" status: 200 len: 1303 microversion: 2.1 time: 0.092952 Jul 28 05:36:08.392627 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 386/610] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:36:08 2022] GET /compute/v2.1/servers/76337f4b-add0-4221-8712-c9d29a9c459e => generated 1303 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:36:08.884003 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-4f655324-fe38-4479-b182-9f574bc041a9 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:08.884673 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-4f655324-fe38-4479-b182-9f574bc041a9 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:08.891920 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4f655324-fe38-4479-b182-9f574bc041a9 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:08.892366 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4f655324-fe38-4479-b182-9f574bc041a9 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:08.893147 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4f655324-fe38-4479-b182-9f574bc041a9 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:08.893621 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4f655324-fe38-4479-b182-9f574bc041a9 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:09.024049 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-4f655324-fe38-4479-b182-9f574bc041a9 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:09.032475 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-4f655324-fe38-4479-b182-9f574bc041a9 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:09.034006 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-4f655324-fe38-4479-b182-9f574bc041a9 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:09.035108 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-4f655324-fe38-4479-b182-9f574bc041a9 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 200 len: 1407 microversion: 2.20 time: 0.155008 Jul 28 05:36:09.035665 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 387/611] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:36:08 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 05:36:09.418827 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-2fd41ffe-f77a-4e1c-b5fd-6ab7f183ba3f tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:09.419917 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-2fd41ffe-f77a-4e1c-b5fd-6ab7f183ba3f tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] [instance: 76337f4b-add0-4221-8712-c9d29a9c459e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:09.426469 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2fd41ffe-f77a-4e1c-b5fd-6ab7f183ba3f tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:09.426920 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2fd41ffe-f77a-4e1c-b5fd-6ab7f183ba3f tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:09.427673 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2fd41ffe-f77a-4e1c-b5fd-6ab7f183ba3f tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:09.428106 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2fd41ffe-f77a-4e1c-b5fd-6ab7f183ba3f tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:09.458533 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2fd41ffe-f77a-4e1c-b5fd-6ab7f183ba3f tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:09.458969 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2fd41ffe-f77a-4e1c-b5fd-6ab7f183ba3f tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:09.459413 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.objects.instance [None req-2fd41ffe-f77a-4e1c-b5fd-6ab7f183ba3f tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lazy-loading 'fault' on Instance uuid 76337f4b-add0-4221-8712-c9d29a9c459e {{(pid=124482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 05:36:09.518407 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-2fd41ffe-f77a-4e1c-b5fd-6ab7f183ba3f tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3310483e0e64521999dfcafec143f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce7104e69fe4e15b070558784aa40d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:09.527080 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-2fd41ffe-f77a-4e1c-b5fd-6ab7f183ba3f tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] 10.222.0.33 "GET /compute/v2.1/servers/76337f4b-add0-4221-8712-c9d29a9c459e" status: 200 len: 1303 microversion: 2.1 time: 0.111941 Jul 28 05:36:09.527726 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 388/612] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:36:09 2022] GET /compute/v2.1/servers/76337f4b-add0-4221-8712-c9d29a9c459e => generated 1303 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:36:10.058274 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-56ad5908-7a9e-4fa6-ac19-6806b8b6538f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:10.058954 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-56ad5908-7a9e-4fa6-ac19-6806b8b6538f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:10.060772 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell0:SELECT=2 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:36:10.061810 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell0:SELECT=12 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:36:10.066534 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-56ad5908-7a9e-4fa6-ac19-6806b8b6538f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:10.066987 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-56ad5908-7a9e-4fa6-ac19-6806b8b6538f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:10.068235 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-56ad5908-7a9e-4fa6-ac19-6806b8b6538f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:10.068235 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-56ad5908-7a9e-4fa6-ac19-6806b8b6538f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:10.261717 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-56ad5908-7a9e-4fa6-ac19-6806b8b6538f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:10.271141 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-56ad5908-7a9e-4fa6-ac19-6806b8b6538f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:10.272673 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-56ad5908-7a9e-4fa6-ac19-6806b8b6538f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:10.273886 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-56ad5908-7a9e-4fa6-ac19-6806b8b6538f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 200 len: 1407 microversion: 2.20 time: 0.219900 Jul 28 05:36:10.274477 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 389/613] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:36:10 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 1407 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 05:36:10.548324 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-7a00a093-3e2f-4e16-81c5-a81303a4f990 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:10.548930 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-7a00a093-3e2f-4e16-81c5-a81303a4f990 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] [instance: 76337f4b-add0-4221-8712-c9d29a9c459e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:10.555547 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7a00a093-3e2f-4e16-81c5-a81303a4f990 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:10.555996 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7a00a093-3e2f-4e16-81c5-a81303a4f990 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:10.556752 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7a00a093-3e2f-4e16-81c5-a81303a4f990 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:10.557185 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7a00a093-3e2f-4e16-81c5-a81303a4f990 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:10.570960 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.wsgi [None req-7a00a093-3e2f-4e16-81c5-a81303a4f990 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] HTTP exception thrown: Instance 76337f4b-add0-4221-8712-c9d29a9c459e could not be found. Jul 28 05:36:10.572567 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-7a00a093-3e2f-4e16-81c5-a81303a4f990 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Request method failure captured: Jul 28 05:36:10.572567 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: request: GET /compute/v2.1/servers/76337f4b-add0-4221-8712-c9d29a9c459e HTTP/1.1 Jul 28 05:36:10.572567 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept: application/json Jul 28 05:36:10.572567 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept-Encoding: identity Jul 28 05:36:10.572567 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Connection: close Jul 28 05:36:10.572567 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Length: 0 Jul 28 05:36:10.572567 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Type: application/json Jul 28 05:36:10.572567 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Host: 10.222.0.33 Jul 28 05:36:10.572567 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Openstack-System-Scope: None Jul 28 05:36:10.572567 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: User-Agent: python-urllib3/1.26.10 Jul 28 05:36:10.572567 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Auth-Token: gAAAAABi4h_6J9ItT7xIGVsoZv-KNcCfqckEq0ZG2BRKWre4EikcJKT0z5_NqMKe5Oarp7hJ9xa2Stq-XwnfKt4y7Z3oi1NZssgVNxLH6IcUasKoUJxUkURxyBf4AUN1Ww10JI9A0jfevsAXFaaXgClgKqHOTUW33n6WD56fjF_nGYaWLCectJI Jul 28 05:36:10.572567 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Id: None Jul 28 05:36:10.572567 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Name: None Jul 28 05:36:10.572567 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Identity-Status: Confirmed Jul 28 05:36:10.572567 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Is-Admin-Project: True Jul 28 05:36:10.572567 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Id: default Jul 28 05:36:10.572567 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Name: Default Jul 28 05:36:10.572567 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Id: 6ce7104e69fe4e15b070558784aa40d6 Jul 28 05:36:10.572567 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Name: tempest-VolumesActionsTest-1875343581 Jul 28 05:36:10.572567 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Role: member,reader Jul 28 05:36:10.572567 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Roles: member,reader Jul 28 05:36:10.574138 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6ce7104e69fe4e15b070558784aa40d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6ce7104e69fe4e15b070558784aa40d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6ce7104e69fe4e15b070558784aa40d6", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6ce7104e69fe4e15b070558784aa40d6"}]}] Jul 28 05:36:10.574138 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant: tempest-VolumesActionsTest-1875343581 Jul 28 05:36:10.574138 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Id: 6ce7104e69fe4e15b070558784aa40d6 Jul 28 05:36:10.574138 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Name: tempest-VolumesActionsTest-1875343581 Jul 28 05:36:10.574138 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User: tempest-VolumesActionsTest-1875343581-project Jul 28 05:36:10.574138 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Id: default Jul 28 05:36:10.574138 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Name: Default Jul 28 05:36:10.574138 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Id: c3310483e0e64521999dfcafec143f0f Jul 28 05:36:10.574138 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Name: tempest-VolumesActionsTest-1875343581-project Jul 28 05:36:10.574138 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: method: > Jul 28 05:36:10.574138 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: exception: Instance 76337f4b-add0-4221-8712-c9d29a9c459e could not be found. Jul 28 05:36:10.574138 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: action_args: {'id': '76337f4b-add0-4221-8712-c9d29a9c459e'} Jul 28 05:36:10.575058 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 05:36:10.575058 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:36:10.575058 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 05:36:10.575058 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 05:36:10.575058 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 05:36:10.575058 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 05:36:10.575058 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 05:36:10.575058 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 05:36:10.575058 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 05:36:10.575058 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 05:36:10.575058 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76337f4b-add0-4221-8712-c9d29a9c459e could not be found. Jul 28 05:36:10.575058 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:36:10.575058 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:36:10.575058 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:36:10.575058 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:36:10.575058 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:36:10.575058 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:36:10.575058 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 05:36:10.575058 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 05:36:10.575058 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 05:36:10.577114 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:36:10.577114 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 05:36:10.577114 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 05:36:10.577114 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 05:36:10.577114 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 05:36:10.577114 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 05:36:10.577114 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 05:36:10.577114 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76337f4b-add0-4221-8712-c9d29a9c459e could not be found. Jul 28 05:36:10.577114 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:36:10.577114 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:36:10.577114 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:36:10.577114 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:36:10.577114 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:36:10.577114 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:36:10.577114 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 05:36:10.577114 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 05:36:10.577114 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76337f4b-add0-4221-8712-c9d29a9c459e could not be found. Jul 28 05:36:10.577114 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:36:10.580147 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-7a00a093-3e2f-4e16-81c5-a81303a4f990 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Returning 404 to user: Instance 76337f4b-add0-4221-8712-c9d29a9c459e could not be found. {{(pid=124482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 05:36:10.580147 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-7a00a093-3e2f-4e16-81c5-a81303a4f990 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] 10.222.0.33 "GET /compute/v2.1/servers/76337f4b-add0-4221-8712-c9d29a9c459e" status: 404 len: 111 microversion: 2.1 time: 0.029721 Jul 28 05:36:10.580147 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 390/614] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:36:10 2022] GET /compute/v2.1/servers/76337f4b-add0-4221-8712-c9d29a9c459e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 05:36:10.676180 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-320c11d7-f27b-4877-bc2d-09b2a48d7b73 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1653463942", "imageRef": "4f0ce061-6677-4c2a-9ee1-54a100f21462", "flavorRef": "452", "networks": [{"uuid": "12fe73f5-6d00-47cf-a14d-34af013f8456"}]}} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:36:10.737002 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.network.neutron [None req-320c11d7-f27b-4877-bc2d-09b2a48d7b73 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] validate_networks() for [('12fe73f5-6d00-47cf-a14d-34af013f8456', None, None, None, None, None)] {{(pid=124482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 05:36:11.339446 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-320c11d7-f27b-4877-bc2d-09b2a48d7b73 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Flavor limits 0:0:0 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 05:36:11.340006 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-320c11d7-f27b-4877-bc2d-09b2a48d7b73 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Image limits 0:0:0 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 05:36:11.340330 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-320c11d7-f27b-4877-bc2d-09b2a48d7b73 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Flavor pref 0:0:0 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 05:36:11.340736 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-320c11d7-f27b-4877-bc2d-09b2a48d7b73 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Image pref 0:0:0 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 05:36:11.341180 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-320c11d7-f27b-4877-bc2d-09b2a48d7b73 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 05:36:11.354533 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-320c11d7-f27b-4877-bc2d-09b2a48d7b73 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:11.355092 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-320c11d7-f27b-4877-bc2d-09b2a48d7b73 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:11.355888 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-320c11d7-f27b-4877-bc2d-09b2a48d7b73 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:11.356326 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-320c11d7-f27b-4877-bc2d-09b2a48d7b73 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:11.374056 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.quota [None req-320c11d7-f27b-4877-bc2d-09b2a48d7b73 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Getting quotas for project 6ce7104e69fe4e15b070558784aa40d6. Resources: {'ram', 'instances', 'cores'} {{(pid=124482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 05:36:11.378543 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.quota [None req-320c11d7-f27b-4877-bc2d-09b2a48d7b73 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Getting quotas for user c3310483e0e64521999dfcafec143f0f and project 6ce7104e69fe4e15b070558784aa40d6. Resources: {'ram', 'instances', 'cores'} {{(pid=124482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 05:36:11.389133 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-320c11d7-f27b-4877-bc2d-09b2a48d7b73 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Going to run 1 instances... {{(pid=124482) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 05:36:11.391419 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-320c11d7-f27b-4877-bc2d-09b2a48d7b73 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] [instance: d9e6b4d9-234d-49ae-8696-ac067e997ae8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f0ce061-6677-4c2a-9ee1-54a100f21462',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 05:36:11.499533 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-320c11d7-f27b-4877-bc2d-09b2a48d7b73 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.827258 Jul 28 05:36:11.500178 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 391/615] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Jul 28 05:36:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 829 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 05:36:11.504617 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-5a9c6199-a3e6-450a-b553-7ac765317319 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:11.505217 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-5a9c6199-a3e6-450a-b553-7ac765317319 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:11.514147 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5a9c6199-a3e6-450a-b553-7ac765317319 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:11.514147 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5a9c6199-a3e6-450a-b553-7ac765317319 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:11.514147 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5a9c6199-a3e6-450a-b553-7ac765317319 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:11.514147 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5a9c6199-a3e6-450a-b553-7ac765317319 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:11.662772 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-5a9c6199-a3e6-450a-b553-7ac765317319 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:11.667944 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-5a9c6199-a3e6-450a-b553-7ac765317319 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:11.669452 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-5a9c6199-a3e6-450a-b553-7ac765317319 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:11.670775 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-5a9c6199-a3e6-450a-b553-7ac765317319 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 200 len: 1407 microversion: 2.20 time: 0.169682 Jul 28 05:36:11.671489 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 392/616] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:36:11 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:36:11.675752 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-424eb69c-b69a-42fa-8460-92cc5ae794ce tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:11.676343 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-424eb69c-b69a-42fa-8460-92cc5ae794ce tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] [instance: d9e6b4d9-234d-49ae-8696-ac067e997ae8] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:11.728215 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-424eb69c-b69a-42fa-8460-92cc5ae794ce tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3310483e0e64521999dfcafec143f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce7104e69fe4e15b070558784aa40d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:11.735181 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-424eb69c-b69a-42fa-8460-92cc5ae794ce tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] 10.222.0.33 "GET /compute/v2.1/servers/d9e6b4d9-234d-49ae-8696-ac067e997ae8" status: 200 len: 1214 microversion: 2.1 time: 0.062766 Jul 28 05:36:11.735978 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 393/617] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:36:11 2022] GET /compute/v2.1/servers/d9e6b4d9-234d-49ae-8696-ac067e997ae8 => generated 1214 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:36:12.695353 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-d69dce91-8978-47e9-be23-f2f124cdf034 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:12.696244 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-d69dce91-8978-47e9-be23-f2f124cdf034 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:12.702888 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d69dce91-8978-47e9-be23-f2f124cdf034 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:12.703424 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d69dce91-8978-47e9-be23-f2f124cdf034 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:12.704218 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d69dce91-8978-47e9-be23-f2f124cdf034 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:12.704650 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d69dce91-8978-47e9-be23-f2f124cdf034 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:12.840770 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-d69dce91-8978-47e9-be23-f2f124cdf034 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:12.849576 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-d69dce91-8978-47e9-be23-f2f124cdf034 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:12.851070 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-d69dce91-8978-47e9-be23-f2f124cdf034 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:12.852191 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-d69dce91-8978-47e9-be23-f2f124cdf034 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 200 len: 1407 microversion: 2.20 time: 0.161494 Jul 28 05:36:12.852746 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 394/618] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:36:12 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:36:12.879896 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-456403b1-4602-41a0-be2f-d3a423409a37 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:12.880413 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-456403b1-4602-41a0-be2f-d3a423409a37 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] [instance: d9e6b4d9-234d-49ae-8696-ac067e997ae8] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:12.886665 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-456403b1-4602-41a0-be2f-d3a423409a37 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:12.887166 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-456403b1-4602-41a0-be2f-d3a423409a37 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:12.887921 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-456403b1-4602-41a0-be2f-d3a423409a37 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:12.889122 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-456403b1-4602-41a0-be2f-d3a423409a37 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:12.957382 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-456403b1-4602-41a0-be2f-d3a423409a37 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3310483e0e64521999dfcafec143f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce7104e69fe4e15b070558784aa40d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:12.964856 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-456403b1-4602-41a0-be2f-d3a423409a37 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] 10.222.0.33 "GET /compute/v2.1/servers/d9e6b4d9-234d-49ae-8696-ac067e997ae8" status: 200 len: 1266 microversion: 2.1 time: 0.110942 Jul 28 05:36:12.965419 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 395/619] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:36:12 2022] GET /compute/v2.1/servers/d9e6b4d9-234d-49ae-8696-ac067e997ae8 => generated 1266 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:36:13.874410 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-889b9df5-e5c3-4d74-8f3e-ba0f46fc4fc2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:13.875098 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-889b9df5-e5c3-4d74-8f3e-ba0f46fc4fc2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:13.881724 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-889b9df5-e5c3-4d74-8f3e-ba0f46fc4fc2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:13.882265 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-889b9df5-e5c3-4d74-8f3e-ba0f46fc4fc2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:13.883220 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-889b9df5-e5c3-4d74-8f3e-ba0f46fc4fc2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:13.883646 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-889b9df5-e5c3-4d74-8f3e-ba0f46fc4fc2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:14.088676 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-889b9df5-e5c3-4d74-8f3e-ba0f46fc4fc2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:14.096689 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-889b9df5-e5c3-4d74-8f3e-ba0f46fc4fc2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:14.099839 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-889b9df5-e5c3-4d74-8f3e-ba0f46fc4fc2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:14.099839 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-889b9df5-e5c3-4d74-8f3e-ba0f46fc4fc2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 200 len: 1407 microversion: 2.20 time: 0.229281 Jul 28 05:36:14.100494 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 396/620] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:36:13 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 1407 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 05:36:14.110732 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-03ec528e-3fee-4c02-b3a9-e4d23147a3e9 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:14.111341 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-03ec528e-3fee-4c02-b3a9-e4d23147a3e9 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] [instance: d9e6b4d9-234d-49ae-8696-ac067e997ae8] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:14.117324 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-03ec528e-3fee-4c02-b3a9-e4d23147a3e9 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:14.117817 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-03ec528e-3fee-4c02-b3a9-e4d23147a3e9 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:14.118582 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-03ec528e-3fee-4c02-b3a9-e4d23147a3e9 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:14.119022 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-03ec528e-3fee-4c02-b3a9-e4d23147a3e9 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:14.182267 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-03ec528e-3fee-4c02-b3a9-e4d23147a3e9 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3310483e0e64521999dfcafec143f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce7104e69fe4e15b070558784aa40d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:14.190584 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-03ec528e-3fee-4c02-b3a9-e4d23147a3e9 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] 10.222.0.33 "GET /compute/v2.1/servers/d9e6b4d9-234d-49ae-8696-ac067e997ae8" status: 200 len: 1272 microversion: 2.1 time: 0.088995 Jul 28 05:36:14.195498 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 397/621] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:36:14 2022] GET /compute/v2.1/servers/d9e6b4d9-234d-49ae-8696-ac067e997ae8 => generated 1272 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:36:14.798167 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-3d88b330-e381-4a4f-82f3-6a99d0d25a31 req-ccccaf67-19f3-4d93-95ee-1f16ff2412b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54986322-1272-4f12-a108-b8675f3190a6", "name": "network-vif-plugged", "status": "completed", "tag": "bb48c226-cd8a-426b-8392-6dcb3d411b85"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:36:14.807986 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-3d88b330-e381-4a4f-82f3-6a99d0d25a31 req-ccccaf67-19f3-4d93-95ee-1f16ff2412b1 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:14.808430 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-3d88b330-e381-4a4f-82f3-6a99d0d25a31 req-ccccaf67-19f3-4d93-95ee-1f16ff2412b1 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:14.821698 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-3d88b330-e381-4a4f-82f3-6a99d0d25a31 req-ccccaf67-19f3-4d93-95ee-1f16ff2412b1 service nova] Creating event network-vif-plugged:bb48c226-cd8a-426b-8392-6dcb3d411b85 for instance 54986322-1272-4f12-a108-b8675f3190a6 on hv-cinder-79987 Jul 28 05:36:14.827161 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-3d88b330-e381-4a4f-82f3-6a99d0d25a31 req-ccccaf67-19f3-4d93-95ee-1f16ff2412b1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033609 Jul 28 05:36:14.829090 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 398/622] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:36:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 05:36:15.123352 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-34d9c55d-a704-48f6-a42a-c027b2e3e535 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:15.124078 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-34d9c55d-a704-48f6-a42a-c027b2e3e535 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:15.131730 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-34d9c55d-a704-48f6-a42a-c027b2e3e535 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:15.135470 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-34d9c55d-a704-48f6-a42a-c027b2e3e535 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:15.135470 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-34d9c55d-a704-48f6-a42a-c027b2e3e535 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:15.135470 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-34d9c55d-a704-48f6-a42a-c027b2e3e535 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:15.335100 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-34d9c55d-a704-48f6-a42a-c027b2e3e535 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:15.343047 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-34d9c55d-a704-48f6-a42a-c027b2e3e535 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:15.344536 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-34d9c55d-a704-48f6-a42a-c027b2e3e535 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:15.345692 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-34d9c55d-a704-48f6-a42a-c027b2e3e535 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 200 len: 1407 microversion: 2.20 time: 0.227446 Jul 28 05:36:15.354620 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 399/623] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:36:15 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 1407 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 05:36:15.354620 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-454dcd04-a920-4b56-a4ab-4b92880cc401 req-db558727-fb57-42ba-a263-79e7c6f78ded service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9e6b4d9-234d-49ae-8696-ac067e997ae8", "tag": "fe1f17d9-4f02-47a9-919d-20bcf84468a2"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:36:15.360253 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-454dcd04-a920-4b56-a4ab-4b92880cc401 req-db558727-fb57-42ba-a263-79e7c6f78ded service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:15.360697 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-454dcd04-a920-4b56-a4ab-4b92880cc401 req-db558727-fb57-42ba-a263-79e7c6f78ded service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:15.371326 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-454dcd04-a920-4b56-a4ab-4b92880cc401 req-db558727-fb57-42ba-a263-79e7c6f78ded service nova] Creating event network-changed:fe1f17d9-4f02-47a9-919d-20bcf84468a2 for instance d9e6b4d9-234d-49ae-8696-ac067e997ae8 on hv-cinder-79987 Jul 28 05:36:15.376735 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-454dcd04-a920-4b56-a4ab-4b92880cc401 req-db558727-fb57-42ba-a263-79e7c6f78ded service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029342 Jul 28 05:36:15.377315 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 400/624] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:36:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:36:15.382325 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-195566ec-c1d2-4db9-ac05-770072072cc1 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:15.383012 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-195566ec-c1d2-4db9-ac05-770072072cc1 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] [instance: d9e6b4d9-234d-49ae-8696-ac067e997ae8] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:15.389256 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-195566ec-c1d2-4db9-ac05-770072072cc1 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:15.389805 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-195566ec-c1d2-4db9-ac05-770072072cc1 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:15.390599 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-195566ec-c1d2-4db9-ac05-770072072cc1 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:15.391034 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-195566ec-c1d2-4db9-ac05-770072072cc1 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:15.526823 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-195566ec-c1d2-4db9-ac05-770072072cc1 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3310483e0e64521999dfcafec143f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce7104e69fe4e15b070558784aa40d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:15.534929 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-195566ec-c1d2-4db9-ac05-770072072cc1 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] 10.222.0.33 "GET /compute/v2.1/servers/d9e6b4d9-234d-49ae-8696-ac067e997ae8" status: 200 len: 1314 microversion: 2.1 time: 0.156447 Jul 28 05:36:15.539849 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 401/625] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:36:15 2022] GET /compute/v2.1/servers/d9e6b4d9-234d-49ae-8696-ac067e997ae8 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:36:16.370988 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-ece846ad-5c8d-4035-8c39-d9a975719a5e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:16.371640 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-ece846ad-5c8d-4035-8c39-d9a975719a5e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:16.378657 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ece846ad-5c8d-4035-8c39-d9a975719a5e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:16.379102 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ece846ad-5c8d-4035-8c39-d9a975719a5e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:16.379941 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ece846ad-5c8d-4035-8c39-d9a975719a5e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:16.380375 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ece846ad-5c8d-4035-8c39-d9a975719a5e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:16.509949 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-ece846ad-5c8d-4035-8c39-d9a975719a5e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:16.517925 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-ece846ad-5c8d-4035-8c39-d9a975719a5e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:16.519415 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-ece846ad-5c8d-4035-8c39-d9a975719a5e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:16.520767 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-ece846ad-5c8d-4035-8c39-d9a975719a5e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 200 len: 1407 microversion: 2.20 time: 0.153898 Jul 28 05:36:16.521326 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 402/626] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:36:16 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 05:36:16.555876 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-31763e72-5816-40a9-8dc2-5e2e4916c21e tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:16.556484 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-31763e72-5816-40a9-8dc2-5e2e4916c21e tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] [instance: d9e6b4d9-234d-49ae-8696-ac067e997ae8] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:16.564240 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-31763e72-5816-40a9-8dc2-5e2e4916c21e tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:16.564690 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-31763e72-5816-40a9-8dc2-5e2e4916c21e tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:16.565510 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-31763e72-5816-40a9-8dc2-5e2e4916c21e tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:16.565970 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-31763e72-5816-40a9-8dc2-5e2e4916c21e tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:16.702023 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-31763e72-5816-40a9-8dc2-5e2e4916c21e tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3310483e0e64521999dfcafec143f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce7104e69fe4e15b070558784aa40d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:16.709606 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-31763e72-5816-40a9-8dc2-5e2e4916c21e tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] 10.222.0.33 "GET /compute/v2.1/servers/d9e6b4d9-234d-49ae-8696-ac067e997ae8" status: 200 len: 1314 microversion: 2.1 time: 0.157383 Jul 28 05:36:16.710183 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 403/627] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:36:16 2022] GET /compute/v2.1/servers/d9e6b4d9-234d-49ae-8696-ac067e997ae8 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:36:17.544111 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-aa5b45a5-6070-4b71-9498-e1cb3a48df3e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:17.544821 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-aa5b45a5-6070-4b71-9498-e1cb3a48df3e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:17.556244 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-aa5b45a5-6070-4b71-9498-e1cb3a48df3e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:17.556695 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-aa5b45a5-6070-4b71-9498-e1cb3a48df3e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:17.557682 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-aa5b45a5-6070-4b71-9498-e1cb3a48df3e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:17.558114 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-aa5b45a5-6070-4b71-9498-e1cb3a48df3e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:17.708494 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-aa5b45a5-6070-4b71-9498-e1cb3a48df3e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:17.716199 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-aa5b45a5-6070-4b71-9498-e1cb3a48df3e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:17.717979 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-aa5b45a5-6070-4b71-9498-e1cb3a48df3e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:17.719075 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-aa5b45a5-6070-4b71-9498-e1cb3a48df3e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 200 len: 1407 microversion: 2.20 time: 0.178954 Jul 28 05:36:17.719628 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 404/628] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:36:17 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 05:36:17.729680 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-6bcbe128-3d0a-4993-ae4b-3356dcfc2de4 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:17.730469 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-6bcbe128-3d0a-4993-ae4b-3356dcfc2de4 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] [instance: d9e6b4d9-234d-49ae-8696-ac067e997ae8] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:17.736980 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-6bcbe128-3d0a-4993-ae4b-3356dcfc2de4 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:17.737419 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-6bcbe128-3d0a-4993-ae4b-3356dcfc2de4 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:17.738552 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-6bcbe128-3d0a-4993-ae4b-3356dcfc2de4 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:17.738802 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-6bcbe128-3d0a-4993-ae4b-3356dcfc2de4 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:17.871993 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-6bcbe128-3d0a-4993-ae4b-3356dcfc2de4 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3310483e0e64521999dfcafec143f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce7104e69fe4e15b070558784aa40d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:17.874873 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell1:SELECT=100 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:36:17.880980 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-6bcbe128-3d0a-4993-ae4b-3356dcfc2de4 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] 10.222.0.33 "GET /compute/v2.1/servers/d9e6b4d9-234d-49ae-8696-ac067e997ae8" status: 200 len: 1314 microversion: 2.1 time: 0.154744 Jul 28 05:36:17.889079 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 405/629] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:36:17 2022] GET /compute/v2.1/servers/d9e6b4d9-234d-49ae-8696-ac067e997ae8 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:36:18.742564 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-470f79c6-9f86-4bf9-844c-787eeaadbf1b tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:18.743297 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-470f79c6-9f86-4bf9-844c-787eeaadbf1b tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:18.751467 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-470f79c6-9f86-4bf9-844c-787eeaadbf1b tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:18.752145 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-470f79c6-9f86-4bf9-844c-787eeaadbf1b tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:18.752922 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-470f79c6-9f86-4bf9-844c-787eeaadbf1b tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:18.753539 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-470f79c6-9f86-4bf9-844c-787eeaadbf1b tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:18.957570 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-470f79c6-9f86-4bf9-844c-787eeaadbf1b tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:18.973345 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-470f79c6-9f86-4bf9-844c-787eeaadbf1b tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:18.973345 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-470f79c6-9f86-4bf9-844c-787eeaadbf1b tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:18.973345 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-470f79c6-9f86-4bf9-844c-787eeaadbf1b tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 200 len: 1600 microversion: 2.20 time: 0.230658 Jul 28 05:36:18.974005 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 406/630] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:36:18 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 1600 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 05:36:18.975149 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-be4009f1-868b-4097-820a-df8cea37b02f tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:18.975759 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-be4009f1-868b-4097-820a-df8cea37b02f tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] [instance: d9e6b4d9-234d-49ae-8696-ac067e997ae8] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:18.981665 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-be4009f1-868b-4097-820a-df8cea37b02f tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:18.982107 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-be4009f1-868b-4097-820a-df8cea37b02f tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:18.983766 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-be4009f1-868b-4097-820a-df8cea37b02f tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:18.984428 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-be4009f1-868b-4097-820a-df8cea37b02f tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:19.132894 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-be4009f1-868b-4097-820a-df8cea37b02f tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3310483e0e64521999dfcafec143f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce7104e69fe4e15b070558784aa40d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:19.153666 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-be4009f1-868b-4097-820a-df8cea37b02f tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] 10.222.0.33 "GET /compute/v2.1/servers/d9e6b4d9-234d-49ae-8696-ac067e997ae8" status: 200 len: 1314 microversion: 2.1 time: 0.170230 Jul 28 05:36:19.153666 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 407/631] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:36:18 2022] GET /compute/v2.1/servers/d9e6b4d9-234d-49ae-8696-ac067e997ae8 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:36:19.153666 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-c3ffa43a-f497-4bf8-8226-3c3120a4fbf5 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:19.153666 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-c3ffa43a-f497-4bf8-8226-3c3120a4fbf5 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:19.158224 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c3ffa43a-f497-4bf8-8226-3c3120a4fbf5 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:19.158857 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c3ffa43a-f497-4bf8-8226-3c3120a4fbf5 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:19.159559 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c3ffa43a-f497-4bf8-8226-3c3120a4fbf5 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:19.160002 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c3ffa43a-f497-4bf8-8226-3c3120a4fbf5 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:19.260451 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-c3ffa43a-f497-4bf8-8226-3c3120a4fbf5 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.117609 Jul 28 05:36:19.261673 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 408/632] 10.222.0.33 () {60 vars in 1316 bytes} [Thu Jul 28 05:36:19 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6/os-interface => generated 285 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 05:36:20.168221 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-8cb4ccb5-d104-48de-8f78-8060ab2d8e75 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:20.168880 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-8cb4ccb5-d104-48de-8f78-8060ab2d8e75 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] [instance: d9e6b4d9-234d-49ae-8696-ac067e997ae8] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:20.177487 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8cb4ccb5-d104-48de-8f78-8060ab2d8e75 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:20.178304 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8cb4ccb5-d104-48de-8f78-8060ab2d8e75 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:20.179485 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8cb4ccb5-d104-48de-8f78-8060ab2d8e75 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:20.180151 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8cb4ccb5-d104-48de-8f78-8060ab2d8e75 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:20.408156 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-8cb4ccb5-d104-48de-8f78-8060ab2d8e75 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3310483e0e64521999dfcafec143f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce7104e69fe4e15b070558784aa40d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:20.416954 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-8cb4ccb5-d104-48de-8f78-8060ab2d8e75 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] 10.222.0.33 "GET /compute/v2.1/servers/d9e6b4d9-234d-49ae-8696-ac067e997ae8" status: 200 len: 1314 microversion: 2.1 time: 0.255711 Jul 28 05:36:20.425681 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 409/633] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:36:20 2022] GET /compute/v2.1/servers/d9e6b4d9-234d-49ae-8696-ac067e997ae8 => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:36:20.425681 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-642c94e7-b8fd-4d3b-a1e4-d59e0a3a5ac0 req-ecc91c1b-ec27-4472-aa52-898be188c861 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54986322-1272-4f12-a108-b8675f3190a6", "tag": "bb48c226-cd8a-426b-8392-6dcb3d411b85"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:36:20.435251 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-642c94e7-b8fd-4d3b-a1e4-d59e0a3a5ac0 req-ecc91c1b-ec27-4472-aa52-898be188c861 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:20.437251 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-642c94e7-b8fd-4d3b-a1e4-d59e0a3a5ac0 req-ecc91c1b-ec27-4472-aa52-898be188c861 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:20.450274 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-642c94e7-b8fd-4d3b-a1e4-d59e0a3a5ac0 req-ecc91c1b-ec27-4472-aa52-898be188c861 service nova] Creating event network-changed:bb48c226-cd8a-426b-8392-6dcb3d411b85 for instance 54986322-1272-4f12-a108-b8675f3190a6 on hv-cinder-79987 Jul 28 05:36:20.457818 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-642c94e7-b8fd-4d3b-a1e4-d59e0a3a5ac0 req-ecc91c1b-ec27-4472-aa52-898be188c861 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036986 Jul 28 05:36:20.464413 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 410/634] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:36:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:36:20.640011 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-a56fede5-9b4a-49b7-87dd-33440ad636f8 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:20.641359 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-a56fede5-9b4a-49b7-87dd-33440ad636f8 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:20.649238 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a56fede5-9b4a-49b7-87dd-33440ad636f8 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:20.650011 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a56fede5-9b4a-49b7-87dd-33440ad636f8 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:20.651032 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a56fede5-9b4a-49b7-87dd-33440ad636f8 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:20.652670 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a56fede5-9b4a-49b7-87dd-33440ad636f8 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:20.806480 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.objects.instance [None req-a56fede5-9b4a-49b7-87dd-33440ad636f8 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lazy-loading 'services' on Instance uuid 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 {{(pid=124482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 05:36:21.124112 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-a56fede5-9b4a-49b7-87dd-33440ad636f8 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9/os-volume_attachments/694e0bbd-d0e5-40df-96d2-516672ea911a" status: 202 len: 0 microversion: 2.1 time: 0.487939 Jul 28 05:36:21.127774 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 411/635] 10.222.0.33 () {58 vars in 1416 bytes} [Thu Jul 28 05:36:20 2022] DELETE /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9/os-volume_attachments/694e0bbd-d0e5-40df-96d2-516672ea911a => generated 0 bytes in 490 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 05:36:21.133787 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-1ffc6733-9439-44e1-b0dd-e05e121f84c1 req-a7dac21a-519b-48fa-bdbf-714cd995be7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9e6b4d9-234d-49ae-8696-ac067e997ae8", "name": "network-vif-plugged", "status": "completed", "tag": "fe1f17d9-4f02-47a9-919d-20bcf84468a2"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:36:21.160597 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-1ffc6733-9439-44e1-b0dd-e05e121f84c1 req-a7dac21a-519b-48fa-bdbf-714cd995be7a service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:21.161358 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-1ffc6733-9439-44e1-b0dd-e05e121f84c1 req-a7dac21a-519b-48fa-bdbf-714cd995be7a service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:21.179010 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-1ffc6733-9439-44e1-b0dd-e05e121f84c1 req-a7dac21a-519b-48fa-bdbf-714cd995be7a service nova] Creating event network-vif-plugged:fe1f17d9-4f02-47a9-919d-20bcf84468a2 for instance d9e6b4d9-234d-49ae-8696-ac067e997ae8 on hv-cinder-79987 Jul 28 05:36:21.185337 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-1ffc6733-9439-44e1-b0dd-e05e121f84c1 req-a7dac21a-519b-48fa-bdbf-714cd995be7a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059302 Jul 28 05:36:21.187493 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 412/636] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:36:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:36:21.193328 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-ab19d2e0-f7d5-4e01-b6cf-72d64145773d tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:21.197093 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-ab19d2e0-f7d5-4e01-b6cf-72d64145773d tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:21.208478 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ab19d2e0-f7d5-4e01-b6cf-72d64145773d tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:21.209275 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ab19d2e0-f7d5-4e01-b6cf-72d64145773d tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:21.210280 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ab19d2e0-f7d5-4e01-b6cf-72d64145773d tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:21.210879 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ab19d2e0-f7d5-4e01-b6cf-72d64145773d tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:21.256216 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-ab19d2e0-f7d5-4e01-b6cf-72d64145773d tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067254 Jul 28 05:36:21.257125 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 413/637] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Jul 28 05:36:21 2022] GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:36:21.439515 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-af26bcd6-ae6b-4920-a5bf-1a5ab787689a tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:21.440140 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-af26bcd6-ae6b-4920-a5bf-1a5ab787689a tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] [instance: d9e6b4d9-234d-49ae-8696-ac067e997ae8] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:21.444915 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell0:SELECT=2 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:36:21.449104 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-af26bcd6-ae6b-4920-a5bf-1a5ab787689a tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:21.449593 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-af26bcd6-ae6b-4920-a5bf-1a5ab787689a tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:21.450381 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-af26bcd6-ae6b-4920-a5bf-1a5ab787689a tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:21.450813 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-af26bcd6-ae6b-4920-a5bf-1a5ab787689a tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:21.733136 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell0:SELECT=8 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:36:21.813066 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-af26bcd6-ae6b-4920-a5bf-1a5ab787689a tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3310483e0e64521999dfcafec143f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce7104e69fe4e15b070558784aa40d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:21.834086 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-af26bcd6-ae6b-4920-a5bf-1a5ab787689a tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] 10.222.0.33 "GET /compute/v2.1/servers/d9e6b4d9-234d-49ae-8696-ac067e997ae8" status: 200 len: 1314 microversion: 2.1 time: 0.394941 Jul 28 05:36:21.845501 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 414/638] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:36:21 2022] GET /compute/v2.1/servers/d9e6b4d9-234d-49ae-8696-ac067e997ae8 => generated 1314 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:36:22.276344 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-993e5b95-bd4a-42da-925e-3b02e2112bf4 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:22.281263 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-993e5b95-bd4a-42da-925e-3b02e2112bf4 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:22.290501 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-993e5b95-bd4a-42da-925e-3b02e2112bf4 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:22.291126 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-993e5b95-bd4a-42da-925e-3b02e2112bf4 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:22.292078 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-993e5b95-bd4a-42da-925e-3b02e2112bf4 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:22.292658 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-993e5b95-bd4a-42da-925e-3b02e2112bf4 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:22.335028 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-993e5b95-bd4a-42da-925e-3b02e2112bf4 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066439 Jul 28 05:36:22.336151 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 415/639] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Jul 28 05:36:22 2022] GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:36:22.859255 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-52e83540-1bab-4e0b-aa06-f0efb00d0cb3 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:22.860027 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-52e83540-1bab-4e0b-aa06-f0efb00d0cb3 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] [instance: d9e6b4d9-234d-49ae-8696-ac067e997ae8] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:22.866185 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-52e83540-1bab-4e0b-aa06-f0efb00d0cb3 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:22.866636 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-52e83540-1bab-4e0b-aa06-f0efb00d0cb3 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:22.867512 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-52e83540-1bab-4e0b-aa06-f0efb00d0cb3 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:22.867955 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-52e83540-1bab-4e0b-aa06-f0efb00d0cb3 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:23.086071 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-52e83540-1bab-4e0b-aa06-f0efb00d0cb3 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3310483e0e64521999dfcafec143f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce7104e69fe4e15b070558784aa40d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:23.096725 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-52e83540-1bab-4e0b-aa06-f0efb00d0cb3 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] 10.222.0.33 "GET /compute/v2.1/servers/d9e6b4d9-234d-49ae-8696-ac067e997ae8" status: 200 len: 1314 microversion: 2.1 time: 0.241420 Jul 28 05:36:23.097313 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 416/640] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:36:22 2022] GET /compute/v2.1/servers/d9e6b4d9-234d-49ae-8696-ac067e997ae8 => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:36:23.348050 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-f64004e7-f2ad-463b-b10b-0982eed0d861 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:23.351021 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-f64004e7-f2ad-463b-b10b-0982eed0d861 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:23.358279 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f64004e7-f2ad-463b-b10b-0982eed0d861 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:23.359308 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f64004e7-f2ad-463b-b10b-0982eed0d861 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:23.360256 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f64004e7-f2ad-463b-b10b-0982eed0d861 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:23.360916 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f64004e7-f2ad-463b-b10b-0982eed0d861 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:23.406577 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-f64004e7-f2ad-463b-b10b-0982eed0d861 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061728 Jul 28 05:36:23.419192 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 417/641] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Jul 28 05:36:23 2022] GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9/os-volume_attachments => generated 25 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 05:36:23.508378 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-2d36df81-f0ea-40e8-8048-a146f332d203 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:23.508969 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-2d36df81-f0ea-40e8-8048-a146f332d203 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:23.522274 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2d36df81-f0ea-40e8-8048-a146f332d203 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:23.522728 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2d36df81-f0ea-40e8-8048-a146f332d203 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:23.523513 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2d36df81-f0ea-40e8-8048-a146f332d203 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:23.523952 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2d36df81-f0ea-40e8-8048-a146f332d203 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:23.550760 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-2d36df81-f0ea-40e8-8048-a146f332d203 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9] Going to try to terminate instance {{(pid=124482) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 05:36:23.866207 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-2d36df81-f0ea-40e8-8048-a146f332d203 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9" status: 204 len: 0 microversion: 2.1 time: 0.368975 Jul 28 05:36:23.866800 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 418/642] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Jul 28 05:36:23 2022] DELETE /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 05:36:23.875165 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-882a33c2-747a-41dc-8bc4-43cf37376e12 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:23.876061 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-882a33c2-747a-41dc-8bc4-43cf37376e12 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:23.882241 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-882a33c2-747a-41dc-8bc4-43cf37376e12 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:23.882694 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-882a33c2-747a-41dc-8bc4-43cf37376e12 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:23.883475 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-882a33c2-747a-41dc-8bc4-43cf37376e12 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:23.883902 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-882a33c2-747a-41dc-8bc4-43cf37376e12 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:24.125979 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-882a33c2-747a-41dc-8bc4-43cf37376e12 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:24.138516 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-882a33c2-747a-41dc-8bc4-43cf37376e12 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9" status: 200 len: 1689 microversion: 2.1 time: 0.267405 Jul 28 05:36:24.140038 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 419/643] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:36:23 2022] GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 => generated 1689 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:36:24.147988 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-3ca7158c-c052-495d-ad43-ad8de4f7f39a tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:24.148817 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-3ca7158c-c052-495d-ad43-ad8de4f7f39a tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] [instance: d9e6b4d9-234d-49ae-8696-ac067e997ae8] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:24.152020 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:36:24.156910 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3ca7158c-c052-495d-ad43-ad8de4f7f39a tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:24.157605 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3ca7158c-c052-495d-ad43-ad8de4f7f39a tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:24.158536 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3ca7158c-c052-495d-ad43-ad8de4f7f39a tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:24.161337 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3ca7158c-c052-495d-ad43-ad8de4f7f39a tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:24.407242 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-3ca7158c-c052-495d-ad43-ad8de4f7f39a tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3310483e0e64521999dfcafec143f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce7104e69fe4e15b070558784aa40d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:24.432099 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-3ca7158c-c052-495d-ad43-ad8de4f7f39a tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] 10.222.0.33 "GET /compute/v2.1/servers/d9e6b4d9-234d-49ae-8696-ac067e997ae8" status: 200 len: 1497 microversion: 2.1 time: 0.290930 Jul 28 05:36:24.432694 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 420/644] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:36:24 2022] GET /compute/v2.1/servers/d9e6b4d9-234d-49ae-8696-ac067e997ae8 => generated 1497 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:36:25.161339 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-b0e63165-fb7d-4eb4-b9f7-3716b1237b43 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:25.161985 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-b0e63165-fb7d-4eb4-b9f7-3716b1237b43 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:25.168280 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b0e63165-fb7d-4eb4-b9f7-3716b1237b43 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:25.168727 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b0e63165-fb7d-4eb4-b9f7-3716b1237b43 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:25.169564 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b0e63165-fb7d-4eb4-b9f7-3716b1237b43 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:25.170048 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b0e63165-fb7d-4eb4-b9f7-3716b1237b43 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:25.581648 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-b0e63165-fb7d-4eb4-b9f7-3716b1237b43 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:25.583931 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:36:25.595735 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-b0e63165-fb7d-4eb4-b9f7-3716b1237b43 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9" status: 200 len: 1689 microversion: 2.1 time: 0.432811 Jul 28 05:36:25.595735 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 421/645] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:36:25 2022] GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 => generated 1689 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:36:25.595735 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-0d53526e-d4b9-41b1-b768-c8e57c08dabb tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:25.595735 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-0d53526e-d4b9-41b1-b768-c8e57c08dabb tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] [instance: d9e6b4d9-234d-49ae-8696-ac067e997ae8] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:25.601352 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-0d53526e-d4b9-41b1-b768-c8e57c08dabb tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:25.601821 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-0d53526e-d4b9-41b1-b768-c8e57c08dabb tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:25.602620 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-0d53526e-d4b9-41b1-b768-c8e57c08dabb tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:25.603224 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-0d53526e-d4b9-41b1-b768-c8e57c08dabb tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:25.635024 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-0d53526e-d4b9-41b1-b768-c8e57c08dabb tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] [instance: d9e6b4d9-234d-49ae-8696-ac067e997ae8] Going to try to terminate instance {{(pid=124482) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 05:36:25.904133 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-0d53526e-d4b9-41b1-b768-c8e57c08dabb tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d9e6b4d9-234d-49ae-8696-ac067e997ae8" status: 204 len: 0 microversion: 2.1 time: 0.312388 Jul 28 05:36:25.905144 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 422/646] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Jul 28 05:36:25 2022] DELETE /compute/v2.1/servers/d9e6b4d9-234d-49ae-8696-ac067e997ae8 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 05:36:25.913573 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-971e3b5a-a991-45f5-9d92-5177b67b7a90 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:25.914434 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-971e3b5a-a991-45f5-9d92-5177b67b7a90 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] [instance: d9e6b4d9-234d-49ae-8696-ac067e997ae8] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:25.920986 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-971e3b5a-a991-45f5-9d92-5177b67b7a90 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:25.921848 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-971e3b5a-a991-45f5-9d92-5177b67b7a90 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:25.922622 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-971e3b5a-a991-45f5-9d92-5177b67b7a90 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:25.923060 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-971e3b5a-a991-45f5-9d92-5177b67b7a90 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:26.073958 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-971e3b5a-a991-45f5-9d92-5177b67b7a90 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3310483e0e64521999dfcafec143f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce7104e69fe4e15b070558784aa40d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:26.104709 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-971e3b5a-a991-45f5-9d92-5177b67b7a90 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] 10.222.0.33 "GET /compute/v2.1/servers/d9e6b4d9-234d-49ae-8696-ac067e997ae8" status: 200 len: 1503 microversion: 2.1 time: 0.185650 Jul 28 05:36:26.104709 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 423/647] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:36:25 2022] GET /compute/v2.1/servers/d9e6b4d9-234d-49ae-8696-ac067e997ae8 => generated 1503 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:36:26.611621 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-b21cdfe7-e606-40f1-bdca-46b43e4a6589 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:26.613678 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-b21cdfe7-e606-40f1-bdca-46b43e4a6589 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:26.620647 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b21cdfe7-e606-40f1-bdca-46b43e4a6589 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:26.621093 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b21cdfe7-e606-40f1-bdca-46b43e4a6589 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:26.621897 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b21cdfe7-e606-40f1-bdca-46b43e4a6589 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:26.622327 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b21cdfe7-e606-40f1-bdca-46b43e4a6589 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:26.784330 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-b21cdfe7-e606-40f1-bdca-46b43e4a6589 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:26.792241 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-b21cdfe7-e606-40f1-bdca-46b43e4a6589 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9" status: 200 len: 1689 microversion: 2.1 time: 0.184729 Jul 28 05:36:26.792808 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 424/648] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:36:26 2022] GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 => generated 1689 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:36:27.116798 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-1d23faba-32a0-4ea1-ba24-b0e0cd9b31ae tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:27.117700 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-1d23faba-32a0-4ea1-ba24-b0e0cd9b31ae tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] [instance: d9e6b4d9-234d-49ae-8696-ac067e997ae8] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:27.124307 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1d23faba-32a0-4ea1-ba24-b0e0cd9b31ae tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:27.124883 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1d23faba-32a0-4ea1-ba24-b0e0cd9b31ae tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:27.125745 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1d23faba-32a0-4ea1-ba24-b0e0cd9b31ae tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:27.126176 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1d23faba-32a0-4ea1-ba24-b0e0cd9b31ae tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:27.285955 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-1d23faba-32a0-4ea1-ba24-b0e0cd9b31ae tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3310483e0e64521999dfcafec143f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce7104e69fe4e15b070558784aa40d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:27.294381 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-1d23faba-32a0-4ea1-ba24-b0e0cd9b31ae tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] 10.222.0.33 "GET /compute/v2.1/servers/d9e6b4d9-234d-49ae-8696-ac067e997ae8" status: 200 len: 1503 microversion: 2.1 time: 0.180815 Jul 28 05:36:27.308774 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 425/649] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:36:27 2022] GET /compute/v2.1/servers/d9e6b4d9-234d-49ae-8696-ac067e997ae8 => generated 1503 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:36:27.814078 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-37c494d6-da50-4908-8165-30c72cfe720c tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:27.814782 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-37c494d6-da50-4908-8165-30c72cfe720c tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:27.833069 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-37c494d6-da50-4908-8165-30c72cfe720c tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:27.833532 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-37c494d6-da50-4908-8165-30c72cfe720c tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:27.834305 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-37c494d6-da50-4908-8165-30c72cfe720c tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:27.834733 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-37c494d6-da50-4908-8165-30c72cfe720c tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:28.038531 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-37c494d6-da50-4908-8165-30c72cfe720c tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:28.043446 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-37c494d6-da50-4908-8165-30c72cfe720c tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9" status: 200 len: 1689 microversion: 2.1 time: 0.233850 Jul 28 05:36:28.044529 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 426/650] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:36:27 2022] GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 => generated 1689 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:36:28.316889 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-85bcc887-7557-4ef7-8533-7ea631acd225 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:28.319708 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-85bcc887-7557-4ef7-8533-7ea631acd225 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] [instance: d9e6b4d9-234d-49ae-8696-ac067e997ae8] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:28.325672 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-85bcc887-7557-4ef7-8533-7ea631acd225 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:28.327235 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-85bcc887-7557-4ef7-8533-7ea631acd225 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:28.328346 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-85bcc887-7557-4ef7-8533-7ea631acd225 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:28.328960 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-85bcc887-7557-4ef7-8533-7ea631acd225 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:28.499629 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-85bcc887-7557-4ef7-8533-7ea631acd225 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3310483e0e64521999dfcafec143f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce7104e69fe4e15b070558784aa40d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:28.508814 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-85bcc887-7557-4ef7-8533-7ea631acd225 tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] 10.222.0.33 "GET /compute/v2.1/servers/d9e6b4d9-234d-49ae-8696-ac067e997ae8" status: 200 len: 1503 microversion: 2.1 time: 0.196103 Jul 28 05:36:28.509530 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 427/651] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:36:28 2022] GET /compute/v2.1/servers/d9e6b4d9-234d-49ae-8696-ac067e997ae8 => generated 1503 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:36:29.068373 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-af306107-ceff-4039-9de6-a9eb991e13df tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:29.069014 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-af306107-ceff-4039-9de6-a9eb991e13df tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:29.076943 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-af306107-ceff-4039-9de6-a9eb991e13df tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:29.077677 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-af306107-ceff-4039-9de6-a9eb991e13df tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:29.078697 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-af306107-ceff-4039-9de6-a9eb991e13df tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:29.079613 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-af306107-ceff-4039-9de6-a9eb991e13df tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:29.341816 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-af306107-ceff-4039-9de6-a9eb991e13df tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:29.351230 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-af306107-ceff-4039-9de6-a9eb991e13df tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9" status: 200 len: 1689 microversion: 2.1 time: 0.287616 Jul 28 05:36:29.352838 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 428/652] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:36:29 2022] GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 => generated 1689 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:36:29.359726 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-8d4f6b01-b26b-43fe-8b68-5cca2458c953 req-77fd8c75-f832-41a6-840a-154559b82906 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9e6b4d9-234d-49ae-8696-ac067e997ae8", "name": "network-vif-deleted", "tag": "fe1f17d9-4f02-47a9-919d-20bcf84468a2"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:36:29.372042 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-8d4f6b01-b26b-43fe-8b68-5cca2458c953 req-77fd8c75-f832-41a6-840a-154559b82906 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:29.372673 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-8d4f6b01-b26b-43fe-8b68-5cca2458c953 req-77fd8c75-f832-41a6-840a-154559b82906 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:29.390606 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-8d4f6b01-b26b-43fe-8b68-5cca2458c953 req-77fd8c75-f832-41a6-840a-154559b82906 service nova] Creating event network-vif-deleted:fe1f17d9-4f02-47a9-919d-20bcf84468a2 for instance d9e6b4d9-234d-49ae-8696-ac067e997ae8 on hv-cinder-79987 Jul 28 05:36:29.397376 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-8d4f6b01-b26b-43fe-8b68-5cca2458c953 req-77fd8c75-f832-41a6-840a-154559b82906 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042724 Jul 28 05:36:29.401281 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 429/653] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:36:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:36:29.531950 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-8086895a-6276-4734-807f-3ba73c54c61c tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:29.533115 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-8086895a-6276-4734-807f-3ba73c54c61c tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] [instance: d9e6b4d9-234d-49ae-8696-ac067e997ae8] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:29.541654 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8086895a-6276-4734-807f-3ba73c54c61c tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:29.542324 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8086895a-6276-4734-807f-3ba73c54c61c tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:29.543313 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8086895a-6276-4734-807f-3ba73c54c61c tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:29.543961 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8086895a-6276-4734-807f-3ba73c54c61c tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:29.632120 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-8086895a-6276-4734-807f-3ba73c54c61c tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3310483e0e64521999dfcafec143f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce7104e69fe4e15b070558784aa40d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:29.643284 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-8086895a-6276-4734-807f-3ba73c54c61c tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] 10.222.0.33 "GET /compute/v2.1/servers/d9e6b4d9-234d-49ae-8696-ac067e997ae8" status: 200 len: 1299 microversion: 2.1 time: 0.114851 Jul 28 05:36:29.644557 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 430/654] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:36:29 2022] GET /compute/v2.1/servers/d9e6b4d9-234d-49ae-8696-ac067e997ae8 => generated 1299 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:36:30.224151 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-21730a8c-81ef-4a1f-8e8f-264dc7c6c702 req-3910421e-a915-409f-af45-34ef7a9f49b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9", "name": "network-vif-deleted", "tag": "1507aad5-e944-47e5-a8d9-716f5bde1fff"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:36:30.244926 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-21730a8c-81ef-4a1f-8e8f-264dc7c6c702 req-3910421e-a915-409f-af45-34ef7a9f49b4 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:30.245510 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-21730a8c-81ef-4a1f-8e8f-264dc7c6c702 req-3910421e-a915-409f-af45-34ef7a9f49b4 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:30.267835 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-21730a8c-81ef-4a1f-8e8f-264dc7c6c702 req-3910421e-a915-409f-af45-34ef7a9f49b4 service nova] Creating event network-vif-deleted:1507aad5-e944-47e5-a8d9-716f5bde1fff for instance 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 on hv-cinder-79987 Jul 28 05:36:30.270561 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-21730a8c-81ef-4a1f-8e8f-264dc7c6c702 req-3910421e-a915-409f-af45-34ef7a9f49b4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055854 Jul 28 05:36:30.271510 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 431/655] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:36:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 05:36:30.374255 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-17b4c9bf-873f-4059-ac3a-3b5255aa425a tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:30.375030 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-17b4c9bf-873f-4059-ac3a-3b5255aa425a tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:30.389672 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-17b4c9bf-873f-4059-ac3a-3b5255aa425a tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:30.390889 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-17b4c9bf-873f-4059-ac3a-3b5255aa425a tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:30.392117 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-17b4c9bf-873f-4059-ac3a-3b5255aa425a tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:30.396467 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-17b4c9bf-873f-4059-ac3a-3b5255aa425a tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:30.542981 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-17b4c9bf-873f-4059-ac3a-3b5255aa425a tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:30.553483 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-17b4c9bf-873f-4059-ac3a-3b5255aa425a tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9" status: 200 len: 1331 microversion: 2.1 time: 0.184816 Jul 28 05:36:30.555163 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 432/656] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:36:30 2022] GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 => generated 1331 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:36:30.666645 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-03e7afee-55f1-4621-a021-97f2bd087daf tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:30.668126 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-03e7afee-55f1-4621-a021-97f2bd087daf tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] [instance: d9e6b4d9-234d-49ae-8696-ac067e997ae8] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:30.678589 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-03e7afee-55f1-4621-a021-97f2bd087daf tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:30.679827 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-03e7afee-55f1-4621-a021-97f2bd087daf tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:30.680940 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-03e7afee-55f1-4621-a021-97f2bd087daf tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:30.681919 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-03e7afee-55f1-4621-a021-97f2bd087daf tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:30.700218 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.wsgi [None req-03e7afee-55f1-4621-a021-97f2bd087daf tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] HTTP exception thrown: Instance d9e6b4d9-234d-49ae-8696-ac067e997ae8 could not be found. Jul 28 05:36:30.703816 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-03e7afee-55f1-4621-a021-97f2bd087daf tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Request method failure captured: Jul 28 05:36:30.703816 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: request: GET /compute/v2.1/servers/d9e6b4d9-234d-49ae-8696-ac067e997ae8 HTTP/1.1 Jul 28 05:36:30.703816 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept: application/json Jul 28 05:36:30.703816 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept-Encoding: identity Jul 28 05:36:30.703816 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Connection: close Jul 28 05:36:30.703816 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Length: 0 Jul 28 05:36:30.703816 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Type: application/json Jul 28 05:36:30.703816 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Host: 10.222.0.33 Jul 28 05:36:30.703816 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Openstack-System-Scope: None Jul 28 05:36:30.703816 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: User-Agent: python-urllib3/1.26.10 Jul 28 05:36:30.703816 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Auth-Token: gAAAAABi4h_6J9ItT7xIGVsoZv-KNcCfqckEq0ZG2BRKWre4EikcJKT0z5_NqMKe5Oarp7hJ9xa2Stq-XwnfKt4y7Z3oi1NZssgVNxLH6IcUasKoUJxUkURxyBf4AUN1Ww10JI9A0jfevsAXFaaXgClgKqHOTUW33n6WD56fjF_nGYaWLCectJI Jul 28 05:36:30.703816 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Id: None Jul 28 05:36:30.703816 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Name: None Jul 28 05:36:30.703816 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Identity-Status: Confirmed Jul 28 05:36:30.703816 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Is-Admin-Project: True Jul 28 05:36:30.703816 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Id: default Jul 28 05:36:30.703816 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Name: Default Jul 28 05:36:30.703816 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Id: 6ce7104e69fe4e15b070558784aa40d6 Jul 28 05:36:30.703816 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Name: tempest-VolumesActionsTest-1875343581 Jul 28 05:36:30.703816 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Role: member,reader Jul 28 05:36:30.703816 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Roles: member,reader Jul 28 05:36:30.705443 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6ce7104e69fe4e15b070558784aa40d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6ce7104e69fe4e15b070558784aa40d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6ce7104e69fe4e15b070558784aa40d6", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6ce7104e69fe4e15b070558784aa40d6"}]}] Jul 28 05:36:30.705443 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant: tempest-VolumesActionsTest-1875343581 Jul 28 05:36:30.705443 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Id: 6ce7104e69fe4e15b070558784aa40d6 Jul 28 05:36:30.705443 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Name: tempest-VolumesActionsTest-1875343581 Jul 28 05:36:30.705443 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User: tempest-VolumesActionsTest-1875343581-project Jul 28 05:36:30.705443 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Id: default Jul 28 05:36:30.705443 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Name: Default Jul 28 05:36:30.705443 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Id: c3310483e0e64521999dfcafec143f0f Jul 28 05:36:30.705443 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Name: tempest-VolumesActionsTest-1875343581-project Jul 28 05:36:30.705443 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: method: > Jul 28 05:36:30.705443 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: exception: Instance d9e6b4d9-234d-49ae-8696-ac067e997ae8 could not be found. Jul 28 05:36:30.705443 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: action_args: {'id': 'd9e6b4d9-234d-49ae-8696-ac067e997ae8'} Jul 28 05:36:30.706338 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 05:36:30.706338 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:36:30.706338 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 05:36:30.706338 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 05:36:30.706338 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 05:36:30.706338 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 05:36:30.706338 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 05:36:30.706338 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 05:36:30.706338 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 05:36:30.706338 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 05:36:30.706338 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9e6b4d9-234d-49ae-8696-ac067e997ae8 could not be found. Jul 28 05:36:30.706338 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:36:30.706338 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:36:30.706338 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:36:30.706338 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:36:30.706338 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:36:30.706338 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:36:30.706338 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 05:36:30.706338 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 05:36:30.706338 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 05:36:30.707796 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:36:30.707796 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 05:36:30.707796 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 05:36:30.707796 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 05:36:30.707796 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 05:36:30.707796 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 05:36:30.707796 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 05:36:30.707796 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9e6b4d9-234d-49ae-8696-ac067e997ae8 could not be found. Jul 28 05:36:30.707796 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:36:30.707796 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:36:30.707796 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:36:30.707796 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:36:30.707796 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:36:30.707796 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:36:30.707796 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 05:36:30.707796 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 05:36:30.707796 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9e6b4d9-234d-49ae-8696-ac067e997ae8 could not be found. Jul 28 05:36:30.707796 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:36:30.710820 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-03e7afee-55f1-4621-a021-97f2bd087daf tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] Returning 404 to user: Instance d9e6b4d9-234d-49ae-8696-ac067e997ae8 could not be found. {{(pid=124482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 05:36:30.713115 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-03e7afee-55f1-4621-a021-97f2bd087daf tempest-VolumesActionsTest-1875343581 tempest-VolumesActionsTest-1875343581-project] 10.222.0.33 "GET /compute/v2.1/servers/d9e6b4d9-234d-49ae-8696-ac067e997ae8" status: 404 len: 111 microversion: 2.1 time: 0.052411 Jul 28 05:36:30.728516 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 433/657] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:36:30 2022] GET /compute/v2.1/servers/d9e6b4d9-234d-49ae-8696-ac067e997ae8 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 05:36:31.587112 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-d7ba6658-f0d4-4242-9b39-dd49fc7a506b tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:31.589650 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-d7ba6658-f0d4-4242-9b39-dd49fc7a506b tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:31.603001 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d7ba6658-f0d4-4242-9b39-dd49fc7a506b tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:31.605421 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d7ba6658-f0d4-4242-9b39-dd49fc7a506b tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:31.609074 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d7ba6658-f0d4-4242-9b39-dd49fc7a506b tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:31.611386 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d7ba6658-f0d4-4242-9b39-dd49fc7a506b tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:31.627625 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.wsgi [None req-d7ba6658-f0d4-4242-9b39-dd49fc7a506b tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] HTTP exception thrown: Instance 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 could not be found. Jul 28 05:36:31.629629 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-d7ba6658-f0d4-4242-9b39-dd49fc7a506b tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Request method failure captured: Jul 28 05:36:31.629629 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: request: GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 HTTP/1.1 Jul 28 05:36:31.629629 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept: application/json Jul 28 05:36:31.629629 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept-Encoding: identity Jul 28 05:36:31.629629 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Connection: close Jul 28 05:36:31.629629 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Length: 0 Jul 28 05:36:31.629629 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Type: application/json Jul 28 05:36:31.629629 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Host: 10.222.0.33 Jul 28 05:36:31.629629 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Openstack-System-Scope: None Jul 28 05:36:31.629629 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: User-Agent: python-urllib3/1.26.10 Jul 28 05:36:31.629629 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Auth-Token: gAAAAABi4h84wg4qlFIi1MM6witAk51FDE4BLzXqxMfe6k0jq8CFmcbtqdoBS3AevDrKaw3dmOujUkImtAsInpNCwgYRxMei_nfojXNroWNTr6vsZakpdR__3W76-XDu4xyFhZj-aUFliI2k9fmeYH-hK9oTm36uOAQrbt51a7XSRrj7_QKgyu0 Jul 28 05:36:31.629629 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Id: None Jul 28 05:36:31.629629 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Name: None Jul 28 05:36:31.629629 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Identity-Status: Confirmed Jul 28 05:36:31.629629 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Is-Admin-Project: True Jul 28 05:36:31.629629 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Id: default Jul 28 05:36:31.629629 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Name: Default Jul 28 05:36:31.629629 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Id: 99f094bca18d4939bb22f8d076d3a35c Jul 28 05:36:31.629629 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1728283555 Jul 28 05:36:31.629629 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Role: member,reader Jul 28 05:36:31.629629 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Roles: member,reader Jul 28 05:36:31.631251 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/99f094bca18d4939bb22f8d076d3a35c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/99f094bca18d4939bb22f8d076d3a35c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_99f094bca18d4939bb22f8d076d3a35c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/99f094bca18d4939bb22f8d076d3a35c"}]}] Jul 28 05:36:31.631251 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1728283555 Jul 28 05:36:31.631251 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Id: 99f094bca18d4939bb22f8d076d3a35c Jul 28 05:36:31.631251 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1728283555 Jul 28 05:36:31.631251 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User: tempest-ServerRescueNegativeTestJSON-1728283555-project Jul 28 05:36:31.631251 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Id: default Jul 28 05:36:31.631251 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Name: Default Jul 28 05:36:31.631251 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Id: 4fcc81558e8f4224ad2ea6fb2b7bf0f9 Jul 28 05:36:31.631251 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1728283555-project Jul 28 05:36:31.631251 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: method: > Jul 28 05:36:31.631251 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: exception: Instance 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 could not be found. Jul 28 05:36:31.631251 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: action_args: {'id': '9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9'} Jul 28 05:36:31.632089 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 05:36:31.632089 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:36:31.632089 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 05:36:31.632089 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 05:36:31.632089 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 05:36:31.632089 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 05:36:31.632089 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 05:36:31.632089 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 05:36:31.632089 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 05:36:31.632089 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 05:36:31.632089 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 could not be found. Jul 28 05:36:31.632089 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:36:31.632089 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:36:31.632089 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:36:31.632089 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:36:31.632089 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:36:31.632089 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:36:31.632089 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 05:36:31.632089 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 05:36:31.632089 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 05:36:31.633749 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:36:31.633749 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 05:36:31.633749 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 05:36:31.633749 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 05:36:31.633749 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 05:36:31.633749 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 05:36:31.633749 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 05:36:31.633749 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 could not be found. Jul 28 05:36:31.633749 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:36:31.633749 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:36:31.633749 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:36:31.633749 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:36:31.633749 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:36:31.633749 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:36:31.633749 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 05:36:31.633749 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 05:36:31.633749 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 could not be found. Jul 28 05:36:31.633749 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:36:31.640639 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-d7ba6658-f0d4-4242-9b39-dd49fc7a506b tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Returning 404 to user: Instance 9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 could not be found. {{(pid=124482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 05:36:31.640639 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-d7ba6658-f0d4-4242-9b39-dd49fc7a506b tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9" status: 404 len: 111 microversion: 2.1 time: 0.061031 Jul 28 05:36:31.640639 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 434/658] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:36:31 2022] GET /compute/v2.1/servers/9d6cbc90-945e-4440-9b7f-bb3be5fa7bd9 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 05:36:31.646930 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-f1b0c5f5-30f7-4907-8f19-1ee8dc793da0 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '.version_select at 0x7f25e051ba60>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:31.754694 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-f1b0c5f5-30f7-4907-8f19-1ee8dc793da0 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2068912648" status: 202 len: 0 microversion: 2.1 time: 0.112489 Jul 28 05:36:31.755512 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 435/659] 10.222.0.33 () {58 vars in 1221 bytes} [Thu Jul 28 05:36:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2068912648 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 05:36:37.830781 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-99dec4d4-3c0e-4ad4-9f74-260f44d05aaa tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:37.831833 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-99dec4d4-3c0e-4ad4-9f74-260f44d05aaa tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 86f5c96f-2d88-48b0-862e-ce27c19abfb4] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:37.844396 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-99dec4d4-3c0e-4ad4-9f74-260f44d05aaa tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:37.844959 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-99dec4d4-3c0e-4ad4-9f74-260f44d05aaa tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:37.845791 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-99dec4d4-3c0e-4ad4-9f74-260f44d05aaa tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:37.846240 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-99dec4d4-3c0e-4ad4-9f74-260f44d05aaa tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:37.906919 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-99dec4d4-3c0e-4ad4-9f74-260f44d05aaa tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 86f5c96f-2d88-48b0-862e-ce27c19abfb4] Going to try to terminate instance {{(pid=124482) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 05:36:38.405968 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-99dec4d4-3c0e-4ad4-9f74-260f44d05aaa tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "DELETE /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4" status: 204 len: 0 microversion: 2.1 time: 0.581641 Jul 28 05:36:38.408805 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 436/660] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Jul 28 05:36:37 2022] DELETE /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 05:36:38.424081 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-15e7162c-e994-447a-84dd-fde2e166589b tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:38.425120 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-15e7162c-e994-447a-84dd-fde2e166589b tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: b9162e60-7996-4d4d-964f-6844383357b6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:38.432732 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-15e7162c-e994-447a-84dd-fde2e166589b tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:38.434267 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-15e7162c-e994-447a-84dd-fde2e166589b tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:38.435382 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-15e7162c-e994-447a-84dd-fde2e166589b tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:38.436130 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-15e7162c-e994-447a-84dd-fde2e166589b tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:38.495563 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-15e7162c-e994-447a-84dd-fde2e166589b tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/b9162e60-7996-4d4d-964f-6844383357b6/ips" status: 200 len: 151 microversion: 2.1 time: 0.086646 Jul 28 05:36:38.504132 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 437/661] 10.222.0.33 () {58 vars in 1248 bytes} [Thu Jul 28 05:36:38 2022] GET /compute/v2.1/servers/b9162e60-7996-4d4d-964f-6844383357b6/ips => generated 151 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:36:38.510710 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-df9f2be5-033e-4e77-8199-79ce65f2fa72 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:38.515979 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-df9f2be5-033e-4e77-8199-79ce65f2fa72 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 86f5c96f-2d88-48b0-862e-ce27c19abfb4] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:38.568330 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-df9f2be5-033e-4e77-8199-79ce65f2fa72 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:38.571611 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-df9f2be5-033e-4e77-8199-79ce65f2fa72 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:38.574269 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-df9f2be5-033e-4e77-8199-79ce65f2fa72 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:38.575658 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-df9f2be5-033e-4e77-8199-79ce65f2fa72 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:38.880330 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-df9f2be5-033e-4e77-8199-79ce65f2fa72 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:38.893692 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-df9f2be5-033e-4e77-8199-79ce65f2fa72 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4" status: 200 len: 1508 microversion: 2.1 time: 0.386858 Jul 28 05:36:38.896653 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 438/662] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:36:38 2022] GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4 => generated 1508 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:36:39.917675 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-831ccbeb-e7db-47b1-8118-743a4d3b890e tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:39.918306 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-831ccbeb-e7db-47b1-8118-743a4d3b890e tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 86f5c96f-2d88-48b0-862e-ce27c19abfb4] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:39.926166 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-831ccbeb-e7db-47b1-8118-743a4d3b890e tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:39.927253 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-831ccbeb-e7db-47b1-8118-743a4d3b890e tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:39.928970 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-831ccbeb-e7db-47b1-8118-743a4d3b890e tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:39.929627 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-831ccbeb-e7db-47b1-8118-743a4d3b890e tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:39.933320 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:36:40.104513 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-831ccbeb-e7db-47b1-8118-743a4d3b890e tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:40.114347 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-831ccbeb-e7db-47b1-8118-743a4d3b890e tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4" status: 200 len: 1508 microversion: 2.1 time: 0.200777 Jul 28 05:36:40.114949 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 439/663] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:36:39 2022] GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4 => generated 1508 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:36:40.120018 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-28c46334-9376-4195-9189-313db2e705e3 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:40.122829 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-28c46334-9376-4195-9189-313db2e705e3 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:40.132148 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-28c46334-9376-4195-9189-313db2e705e3 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:40.132708 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-28c46334-9376-4195-9189-313db2e705e3 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:40.133730 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-28c46334-9376-4195-9189-313db2e705e3 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:40.134499 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-28c46334-9376-4195-9189-313db2e705e3 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:40.173297 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-28c46334-9376-4195-9189-313db2e705e3 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057047 Jul 28 05:36:40.179573 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 440/664] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Jul 28 05:36:40 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 05:36:40.257323 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-8385ddea-d40e-4c4b-b1a3-dddf281897b8 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:40.257880 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-8385ddea-d40e-4c4b-b1a3-dddf281897b8 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:40.265043 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8385ddea-d40e-4c4b-b1a3-dddf281897b8 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:40.265593 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8385ddea-d40e-4c4b-b1a3-dddf281897b8 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:40.267585 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8385ddea-d40e-4c4b-b1a3-dddf281897b8 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:40.268125 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8385ddea-d40e-4c4b-b1a3-dddf281897b8 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:40.297489 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-8385ddea-d40e-4c4b-b1a3-dddf281897b8 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Going to try to terminate instance {{(pid=124482) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 05:36:40.834285 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-8385ddea-d40e-4c4b-b1a3-dddf281897b8 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 204 len: 0 microversion: 2.1 time: 0.580428 Jul 28 05:36:40.834912 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 441/665] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Jul 28 05:36:40 2022] DELETE /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 05:36:40.843441 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-510ea25c-faf7-48bf-ad54-8a195cd62615 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "94b9b7b8-95d0-4908-b86d-bd7ce54d93d9"}} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:36:40.845861 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-510ea25c-faf7-48bf-ad54-8a195cd62615 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: b9162e60-7996-4d4d-964f-6844383357b6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:40.851850 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-510ea25c-faf7-48bf-ad54-8a195cd62615 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:40.852293 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-510ea25c-faf7-48bf-ad54-8a195cd62615 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:40.853048 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-510ea25c-faf7-48bf-ad54-8a195cd62615 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:40.853534 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-510ea25c-faf7-48bf-ad54-8a195cd62615 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:44.369796 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-510ea25c-faf7-48bf-ad54-8a195cd62615 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "POST /compute/v2.1/servers/b9162e60-7996-4d4d-964f-6844383357b6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.530442 Jul 28 05:36:44.376709 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 442/666] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Jul 28 05:36:40 2022] POST /compute/v2.1/servers/b9162e60-7996-4d4d-964f-6844383357b6/os-volume_attachments => generated 194 bytes in 3541 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:36:44.383317 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-75562d55-155f-4e29-9874-56201b3f271b tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:44.384239 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-75562d55-155f-4e29-9874-56201b3f271b tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:44.392360 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-75562d55-155f-4e29-9874-56201b3f271b tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:44.392924 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-75562d55-155f-4e29-9874-56201b3f271b tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:44.393788 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-75562d55-155f-4e29-9874-56201b3f271b tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:44.394422 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-75562d55-155f-4e29-9874-56201b3f271b tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:44.783333 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-75562d55-155f-4e29-9874-56201b3f271b tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:44.803807 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-75562d55-155f-4e29-9874-56201b3f271b tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 200 len: 1674 microversion: 2.1 time: 0.425480 Jul 28 05:36:44.804894 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 443/667] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:36:44 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 1674 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:36:44.820632 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-e09bff9f-4f2d-47d7-ac38-091a5790fc13 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:44.825167 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-e09bff9f-4f2d-47d7-ac38-091a5790fc13 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 86f5c96f-2d88-48b0-862e-ce27c19abfb4] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:44.843465 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e09bff9f-4f2d-47d7-ac38-091a5790fc13 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:44.843929 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e09bff9f-4f2d-47d7-ac38-091a5790fc13 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:44.859048 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e09bff9f-4f2d-47d7-ac38-091a5790fc13 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:44.859436 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e09bff9f-4f2d-47d7-ac38-091a5790fc13 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:44.944565 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e09bff9f-4f2d-47d7-ac38-091a5790fc13 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:44.946606 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e09bff9f-4f2d-47d7-ac38-091a5790fc13 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:44.947268 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.objects.instance [None req-e09bff9f-4f2d-47d7-ac38-091a5790fc13 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lazy-loading 'fault' on Instance uuid 86f5c96f-2d88-48b0-862e-ce27c19abfb4 {{(pid=124482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 05:36:45.076394 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-e09bff9f-4f2d-47d7-ac38-091a5790fc13 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:45.084500 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-e09bff9f-4f2d-47d7-ac38-091a5790fc13 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4" status: 200 len: 1312 microversion: 2.1 time: 0.278357 Jul 28 05:36:45.087801 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 444/668] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:36:44 2022] GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4 => generated 1312 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:36:45.093249 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-46a25ed7-f5ca-4fa0-8755-d339175db2ae req-e2304b5e-b51e-4504-923e-bbd22d4f64c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86f5c96f-2d88-48b0-862e-ce27c19abfb4", "name": "network-vif-deleted", "tag": "7685d4b0-825f-4ec9-b8cb-496d80179339"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:36:45.123928 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-46a25ed7-f5ca-4fa0-8755-d339175db2ae req-e2304b5e-b51e-4504-923e-bbd22d4f64c6 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:45.124870 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-46a25ed7-f5ca-4fa0-8755-d339175db2ae req-e2304b5e-b51e-4504-923e-bbd22d4f64c6 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:45.165514 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-46a25ed7-f5ca-4fa0-8755-d339175db2ae req-e2304b5e-b51e-4504-923e-bbd22d4f64c6 service nova] Creating event network-vif-deleted:7685d4b0-825f-4ec9-b8cb-496d80179339 for instance 86f5c96f-2d88-48b0-862e-ce27c19abfb4 on hv-cinder-79987 Jul 28 05:36:45.186596 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-46a25ed7-f5ca-4fa0-8755-d339175db2ae req-e2304b5e-b51e-4504-923e-bbd22d4f64c6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094610 Jul 28 05:36:45.191848 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 445/669] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:36:45.434150 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-d147eb47-6a9f-4b74-a380-2dca41a0844e req-2359225e-90c7-48bd-9234-e2e171d92386 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0539d466-3f2e-414a-8563-45ad82a3f268", "name": "network-vif-deleted", "tag": "4306092c-5986-4fc4-a865-0baac79b0fbf"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:36:45.444116 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-d147eb47-6a9f-4b74-a380-2dca41a0844e req-2359225e-90c7-48bd-9234-e2e171d92386 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:45.444558 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-d147eb47-6a9f-4b74-a380-2dca41a0844e req-2359225e-90c7-48bd-9234-e2e171d92386 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:45.461672 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-d147eb47-6a9f-4b74-a380-2dca41a0844e req-2359225e-90c7-48bd-9234-e2e171d92386 service nova] Creating event network-vif-deleted:4306092c-5986-4fc4-a865-0baac79b0fbf for instance 0539d466-3f2e-414a-8563-45ad82a3f268 on hv-cinder-79987 Jul 28 05:36:45.469131 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-d147eb47-6a9f-4b74-a380-2dca41a0844e req-2359225e-90c7-48bd-9234-e2e171d92386 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039010 Jul 28 05:36:45.469997 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 446/670] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 05:36:45.829377 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-a88ea59c-a224-4c50-9d8c-626673b627c2 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:45.830250 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-a88ea59c-a224-4c50-9d8c-626673b627c2 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:45.852175 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a88ea59c-a224-4c50-9d8c-626673b627c2 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:45.854417 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a88ea59c-a224-4c50-9d8c-626673b627c2 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:45.857715 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a88ea59c-a224-4c50-9d8c-626673b627c2 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:45.858510 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a88ea59c-a224-4c50-9d8c-626673b627c2 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:45.903871 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a88ea59c-a224-4c50-9d8c-626673b627c2 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:45.904333 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a88ea59c-a224-4c50-9d8c-626673b627c2 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:45.904789 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.objects.instance [None req-a88ea59c-a224-4c50-9d8c-626673b627c2 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lazy-loading 'fault' on Instance uuid 0539d466-3f2e-414a-8563-45ad82a3f268 {{(pid=124482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 05:36:45.961294 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-a88ea59c-a224-4c50-9d8c-626673b627c2 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:45.971837 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-a88ea59c-a224-4c50-9d8c-626673b627c2 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 200 len: 1327 microversion: 2.1 time: 0.149356 Jul 28 05:36:45.973583 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 447/671] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:36:45 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 1327 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:36:45.978093 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-81bf5965-f3c8-498f-881b-101777da7a37 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Action: 'create', calling method: .version_select at 0x7f25e0323a60>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-759463288", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQ5iZwJYhNpvDDarmBxYo37fnzEXAEubCs1UoogdmnOj8qV8UV0S4bHZMuz2N8NX6dvE+LZv9axTwBGKmaDj2Rlq2kkxjLIBVu3Ye7OhrzfAK0NtvK7rM6JPYfqGuztVQ=="}} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:36:46.001907 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.quota [None req-81bf5965-f3c8-498f-881b-101777da7a37 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Getting quotas for project 5989fabc615545eeb4ef987dea566175. Resources: {'key_pairs'} {{(pid=124482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 05:36:46.008308 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.quota [None req-81bf5965-f3c8-498f-881b-101777da7a37 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Getting quotas for user 7d859e797d874c948325f2ce0978edb6 and project 5989fabc615545eeb4ef987dea566175. Resources: {'key_pairs'} {{(pid=124482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 05:36:46.128613 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-81bf5965-f3c8-498f-881b-101777da7a37 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.154179 Jul 28 05:36:46.129810 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 448/672] 10.222.0.33 () {60 vars in 1159 bytes} [Thu Jul 28 05:36:45 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:36:46.134843 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-cfc16edc-b38d-4f4e-99de-1e8ad2e5fd5d tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:46.135713 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-cfc16edc-b38d-4f4e-99de-1e8ad2e5fd5d tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: 86f5c96f-2d88-48b0-862e-ce27c19abfb4] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:46.155160 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-cfc16edc-b38d-4f4e-99de-1e8ad2e5fd5d tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:46.156131 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-cfc16edc-b38d-4f4e-99de-1e8ad2e5fd5d tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:46.157200 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-cfc16edc-b38d-4f4e-99de-1e8ad2e5fd5d tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:46.157890 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-cfc16edc-b38d-4f4e-99de-1e8ad2e5fd5d tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:46.173158 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.wsgi [None req-cfc16edc-b38d-4f4e-99de-1e8ad2e5fd5d tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] HTTP exception thrown: Instance 86f5c96f-2d88-48b0-862e-ce27c19abfb4 could not be found. Jul 28 05:36:46.175020 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-cfc16edc-b38d-4f4e-99de-1e8ad2e5fd5d tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Request method failure captured: Jul 28 05:36:46.175020 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: request: GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4 HTTP/1.1 Jul 28 05:36:46.175020 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept: application/json Jul 28 05:36:46.175020 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept-Encoding: identity Jul 28 05:36:46.175020 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Connection: close Jul 28 05:36:46.175020 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Length: 0 Jul 28 05:36:46.175020 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Type: application/json Jul 28 05:36:46.175020 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Host: 10.222.0.33 Jul 28 05:36:46.175020 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Openstack-System-Scope: None Jul 28 05:36:46.175020 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: User-Agent: python-urllib3/1.26.10 Jul 28 05:36:46.175020 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Auth-Token: gAAAAABi4h84wg4qlFIi1MM6witAk51FDE4BLzXqxMfe6k0jq8CFmcbtqdoBS3AevDrKaw3dmOujUkImtAsInpNCwgYRxMei_nfojXNroWNTr6vsZakpdR__3W76-XDu4xyFhZj-aUFliI2k9fmeYH-hK9oTm36uOAQrbt51a7XSRrj7_QKgyu0 Jul 28 05:36:46.175020 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Id: None Jul 28 05:36:46.175020 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Name: None Jul 28 05:36:46.175020 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Identity-Status: Confirmed Jul 28 05:36:46.175020 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Is-Admin-Project: True Jul 28 05:36:46.175020 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Id: default Jul 28 05:36:46.175020 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Name: Default Jul 28 05:36:46.175020 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Id: 99f094bca18d4939bb22f8d076d3a35c Jul 28 05:36:46.175020 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1728283555 Jul 28 05:36:46.175020 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Role: member,reader Jul 28 05:36:46.175020 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Roles: member,reader Jul 28 05:36:46.176687 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/99f094bca18d4939bb22f8d076d3a35c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/99f094bca18d4939bb22f8d076d3a35c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_99f094bca18d4939bb22f8d076d3a35c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/99f094bca18d4939bb22f8d076d3a35c"}]}] Jul 28 05:36:46.176687 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1728283555 Jul 28 05:36:46.176687 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Id: 99f094bca18d4939bb22f8d076d3a35c Jul 28 05:36:46.176687 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1728283555 Jul 28 05:36:46.176687 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User: tempest-ServerRescueNegativeTestJSON-1728283555-project Jul 28 05:36:46.176687 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Id: default Jul 28 05:36:46.176687 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Name: Default Jul 28 05:36:46.176687 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Id: 4fcc81558e8f4224ad2ea6fb2b7bf0f9 Jul 28 05:36:46.176687 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1728283555-project Jul 28 05:36:46.176687 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: method: > Jul 28 05:36:46.176687 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: exception: Instance 86f5c96f-2d88-48b0-862e-ce27c19abfb4 could not be found. Jul 28 05:36:46.176687 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: action_args: {'id': '86f5c96f-2d88-48b0-862e-ce27c19abfb4'} Jul 28 05:36:46.177922 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 05:36:46.177922 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:36:46.177922 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 05:36:46.177922 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 05:36:46.177922 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 05:36:46.177922 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 05:36:46.177922 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 05:36:46.177922 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 05:36:46.177922 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 05:36:46.177922 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 05:36:46.177922 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86f5c96f-2d88-48b0-862e-ce27c19abfb4 could not be found. Jul 28 05:36:46.177922 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:36:46.177922 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:36:46.177922 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:36:46.177922 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:36:46.177922 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:36:46.177922 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:36:46.177922 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 05:36:46.177922 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 05:36:46.177922 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 05:36:46.179356 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:36:46.179356 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 05:36:46.179356 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 05:36:46.179356 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 05:36:46.179356 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 05:36:46.179356 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 05:36:46.179356 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 05:36:46.179356 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86f5c96f-2d88-48b0-862e-ce27c19abfb4 could not be found. Jul 28 05:36:46.179356 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:36:46.179356 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:36:46.179356 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:36:46.179356 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:36:46.179356 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:36:46.179356 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:36:46.179356 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 05:36:46.179356 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 05:36:46.179356 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86f5c96f-2d88-48b0-862e-ce27c19abfb4 could not be found. Jul 28 05:36:46.179356 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:36:46.180613 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-cfc16edc-b38d-4f4e-99de-1e8ad2e5fd5d tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Returning 404 to user: Instance 86f5c96f-2d88-48b0-862e-ce27c19abfb4 could not be found. {{(pid=124482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 05:36:46.180613 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-cfc16edc-b38d-4f4e-99de-1e8ad2e5fd5d tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4" status: 404 len: 111 microversion: 2.1 time: 0.047199 Jul 28 05:36:46.180613 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 449/673] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:36:46 2022] GET /compute/v2.1/servers/86f5c96f-2d88-48b0-862e-ce27c19abfb4 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 05:36:46.191594 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-4dc40b6a-ab25-480b-9c19-dea6e9a2bc50 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:46.196254 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-4dc40b6a-ab25-480b-9c19-dea6e9a2bc50 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: d70d71f4-de27-4d62-acad-c6e9a7a7225e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:46.199887 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4dc40b6a-ab25-480b-9c19-dea6e9a2bc50 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:46.200412 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4dc40b6a-ab25-480b-9c19-dea6e9a2bc50 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:46.201900 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4dc40b6a-ab25-480b-9c19-dea6e9a2bc50 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:46.202412 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4dc40b6a-ab25-480b-9c19-dea6e9a2bc50 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:46.233608 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-4dc40b6a-ab25-480b-9c19-dea6e9a2bc50 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: d70d71f4-de27-4d62-acad-c6e9a7a7225e] Going to try to terminate instance {{(pid=124482) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 05:36:46.554426 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=4,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:36:46.640146 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-4dc40b6a-ab25-480b-9c19-dea6e9a2bc50 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d70d71f4-de27-4d62-acad-c6e9a7a7225e" status: 204 len: 0 microversion: 2.1 time: 0.451135 Jul 28 05:36:46.645000 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 450/674] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Jul 28 05:36:46 2022] DELETE /compute/v2.1/servers/d70d71f4-de27-4d62-acad-c6e9a7a7225e => generated 0 bytes in 454 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 05:36:46.646602 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-574a4ba9-acb2-4dff-b168-fb26d44ced39 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1287451820", "imageRef": "46aea10a-3564-4e24-9ba7-3db76a25adf0", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-759463288", "networks": [{"uuid": "17d0b4db-03c1-4e8e-bad7-973b09ccd533"}]}} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:36:46.702879 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.network.neutron [None req-574a4ba9-acb2-4dff-b168-fb26d44ced39 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] validate_networks() for [('17d0b4db-03c1-4e8e-bad7-973b09ccd533', None, None, None, None, None)] {{(pid=124482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 05:36:47.224680 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-574a4ba9-acb2-4dff-b168-fb26d44ced39 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Flavor limits 0:0:0 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 05:36:47.225015 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-574a4ba9-acb2-4dff-b168-fb26d44ced39 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Image limits 0:0:0 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 05:36:47.225505 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-574a4ba9-acb2-4dff-b168-fb26d44ced39 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Flavor pref 0:0:0 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 05:36:47.226146 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-574a4ba9-acb2-4dff-b168-fb26d44ced39 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Image pref 0:0:0 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 05:36:47.226721 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-574a4ba9-acb2-4dff-b168-fb26d44ced39 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 05:36:47.238200 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-574a4ba9-acb2-4dff-b168-fb26d44ced39 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:47.238913 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-574a4ba9-acb2-4dff-b168-fb26d44ced39 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:47.240442 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-574a4ba9-acb2-4dff-b168-fb26d44ced39 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:47.241051 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-574a4ba9-acb2-4dff-b168-fb26d44ced39 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:47.275065 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.quota [None req-574a4ba9-acb2-4dff-b168-fb26d44ced39 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Getting quotas for project 5989fabc615545eeb4ef987dea566175. Resources: {'ram', 'instances', 'cores'} {{(pid=124482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 05:36:47.279883 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.quota [None req-574a4ba9-acb2-4dff-b168-fb26d44ced39 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Getting quotas for user 7d859e797d874c948325f2ce0978edb6 and project 5989fabc615545eeb4ef987dea566175. Resources: {'ram', 'instances', 'cores'} {{(pid=124482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 05:36:47.293960 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-574a4ba9-acb2-4dff-b168-fb26d44ced39 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Going to run 1 instances... {{(pid=124482) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 05:36:47.296592 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-574a4ba9-acb2-4dff-b168-fb26d44ced39 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] [instance: 549e692f-7b6f-4ab0-987b-986a1934630e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='46aea10a-3564-4e24-9ba7-3db76a25adf0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 05:36:47.449371 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-574a4ba9-acb2-4dff-b168-fb26d44ced39 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.807236 Jul 28 05:36:47.456687 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 451/675] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Jul 28 05:36:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 815 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 05:36:47.461749 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-7baeafd7-5b76-4ccd-92a1-e90d693bbf76 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:47.462220 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-7baeafd7-5b76-4ccd-92a1-e90d693bbf76 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: d70d71f4-de27-4d62-acad-c6e9a7a7225e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:47.469127 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7baeafd7-5b76-4ccd-92a1-e90d693bbf76 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:47.469765 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7baeafd7-5b76-4ccd-92a1-e90d693bbf76 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:47.470528 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7baeafd7-5b76-4ccd-92a1-e90d693bbf76 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:47.471899 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7baeafd7-5b76-4ccd-92a1-e90d693bbf76 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:47.630859 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-7baeafd7-5b76-4ccd-92a1-e90d693bbf76 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:47.645607 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-7baeafd7-5b76-4ccd-92a1-e90d693bbf76 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/d70d71f4-de27-4d62-acad-c6e9a7a7225e" status: 200 len: 1522 microversion: 2.1 time: 0.187888 Jul 28 05:36:47.646389 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 452/676] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:36:47 2022] GET /compute/v2.1/servers/d70d71f4-de27-4d62-acad-c6e9a7a7225e => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:36:47.651349 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-90800abd-1c6f-4cf0-a656-169ca9cbdc33 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:47.656860 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-90800abd-1c6f-4cf0-a656-169ca9cbdc33 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:47.667790 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-90800abd-1c6f-4cf0-a656-169ca9cbdc33 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:47.668505 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-90800abd-1c6f-4cf0-a656-169ca9cbdc33 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:47.670079 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-90800abd-1c6f-4cf0-a656-169ca9cbdc33 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:47.670686 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-90800abd-1c6f-4cf0-a656-169ca9cbdc33 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:47.841782 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.wsgi [None req-90800abd-1c6f-4cf0-a656-169ca9cbdc33 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] HTTP exception thrown: Instance 0539d466-3f2e-414a-8563-45ad82a3f268 could not be found. Jul 28 05:36:47.843653 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-90800abd-1c6f-4cf0-a656-169ca9cbdc33 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Request method failure captured: Jul 28 05:36:47.843653 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: request: GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 HTTP/1.1 Jul 28 05:36:47.843653 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept: application/json Jul 28 05:36:47.843653 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept-Encoding: identity Jul 28 05:36:47.843653 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Connection: close Jul 28 05:36:47.843653 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Length: 0 Jul 28 05:36:47.843653 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Type: application/json Jul 28 05:36:47.843653 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Host: 10.222.0.33 Jul 28 05:36:47.843653 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Openstack-System-Scope: None Jul 28 05:36:47.843653 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: User-Agent: python-urllib3/1.26.10 Jul 28 05:36:47.843653 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Auth-Token: gAAAAABi4h83Xk7EohK6Ame0qqOjGVY0juEF6cixUUoN_nYeQOByClF9kUE2WC255jRgZjiBO-WvLks3jgM32fmGkUqUx4mTlP04nY78d2XJqH99wvWbHTy--wvnzUdM8tWiTYSpYV9O6enIYtVJrTR93S-aavCuDGofU0YWMspCK5-J78eoDSU Jul 28 05:36:47.843653 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Id: None Jul 28 05:36:47.843653 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Name: None Jul 28 05:36:47.843653 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Identity-Status: Confirmed Jul 28 05:36:47.843653 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Is-Admin-Project: True Jul 28 05:36:47.843653 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Id: default Jul 28 05:36:47.843653 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Name: Default Jul 28 05:36:47.843653 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Id: 7b96e460476f4bc9b35224e38b33f4c7 Jul 28 05:36:47.843653 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Name: tempest-AttachVolumeTestJSON-419609059 Jul 28 05:36:47.843653 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Role: member,reader Jul 28 05:36:47.843653 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Roles: member,reader Jul 28 05:36:47.845154 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7b96e460476f4bc9b35224e38b33f4c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7b96e460476f4bc9b35224e38b33f4c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7b96e460476f4bc9b35224e38b33f4c7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7b96e460476f4bc9b35224e38b33f4c7"}]}] Jul 28 05:36:47.845154 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant: tempest-AttachVolumeTestJSON-419609059 Jul 28 05:36:47.845154 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Id: 7b96e460476f4bc9b35224e38b33f4c7 Jul 28 05:36:47.845154 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Name: tempest-AttachVolumeTestJSON-419609059 Jul 28 05:36:47.845154 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User: tempest-AttachVolumeTestJSON-419609059-project Jul 28 05:36:47.845154 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Id: default Jul 28 05:36:47.845154 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Name: Default Jul 28 05:36:47.845154 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Id: b3c43b517c8a464c93f0ce620826ad35 Jul 28 05:36:47.845154 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Name: tempest-AttachVolumeTestJSON-419609059-project Jul 28 05:36:47.845154 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: method: > Jul 28 05:36:47.845154 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: exception: Instance 0539d466-3f2e-414a-8563-45ad82a3f268 could not be found. Jul 28 05:36:47.845154 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: action_args: {'id': '0539d466-3f2e-414a-8563-45ad82a3f268'} Jul 28 05:36:47.846058 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 05:36:47.846058 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:36:47.846058 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 05:36:47.846058 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 05:36:47.846058 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 05:36:47.846058 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 05:36:47.846058 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 05:36:47.846058 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 05:36:47.846058 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 05:36:47.846058 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 05:36:47.846058 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0539d466-3f2e-414a-8563-45ad82a3f268 could not be found. Jul 28 05:36:47.846058 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:36:47.846058 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:36:47.846058 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:36:47.846058 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:36:47.846058 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:36:47.846058 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:36:47.846058 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 05:36:47.846058 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 05:36:47.846058 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 05:36:47.847451 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:36:47.847451 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 05:36:47.847451 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 05:36:47.847451 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 05:36:47.847451 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 05:36:47.847451 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 05:36:47.847451 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 05:36:47.847451 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0539d466-3f2e-414a-8563-45ad82a3f268 could not be found. Jul 28 05:36:47.847451 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:36:47.847451 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:36:47.847451 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:36:47.847451 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:36:47.847451 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:36:47.847451 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:36:47.847451 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 05:36:47.847451 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 05:36:47.847451 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0539d466-3f2e-414a-8563-45ad82a3f268 could not be found. Jul 28 05:36:47.847451 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:36:47.848880 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-90800abd-1c6f-4cf0-a656-169ca9cbdc33 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Returning 404 to user: Instance 0539d466-3f2e-414a-8563-45ad82a3f268 could not be found. {{(pid=124482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 05:36:47.848880 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-90800abd-1c6f-4cf0-a656-169ca9cbdc33 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 404 len: 111 microversion: 2.1 time: 0.197177 Jul 28 05:36:47.848880 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 453/677] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:36:47 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 111 bytes in 198 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 05:36:47.850445 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-87944d27-7dec-45a1-9eab-9b3451ab6d44 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:47.851273 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-87944d27-7dec-45a1-9eab-9b3451ab6d44 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] [instance: 549e692f-7b6f-4ab0-987b-986a1934630e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:47.933994 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-87944d27-7dec-45a1-9eab-9b3451ab6d44 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d859e797d874c948325f2ce0978edb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5989fabc615545eeb4ef987dea566175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:47.943600 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-87944d27-7dec-45a1-9eab-9b3451ab6d44 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] 10.222.0.33 "GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e" status: 200 len: 1258 microversion: 2.1 time: 0.097033 Jul 28 05:36:47.944513 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 454/678] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:36:47 2022] GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e => generated 1258 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:36:47.962391 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-f9ba86f9-19a4-4e0c-8784-c9f92a3ae391 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '.version_select at 0x7f25e025fb80>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:48.179718 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-f9ba86f9-19a4-4e0c-8784-c9f92a3ae391 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-674403098" status: 202 len: 0 microversion: 2.1 time: 0.221031 Jul 28 05:36:48.180417 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 455/679] 10.222.0.33 () {58 vars in 1218 bytes} [Thu Jul 28 05:36:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-674403098 => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 05:36:48.674490 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-a72e40d8-fb7e-47d1-b859-aca4f6c58d33 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:48.675859 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-a72e40d8-fb7e-47d1-b859-aca4f6c58d33 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: d70d71f4-de27-4d62-acad-c6e9a7a7225e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:48.688742 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a72e40d8-fb7e-47d1-b859-aca4f6c58d33 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:48.689204 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a72e40d8-fb7e-47d1-b859-aca4f6c58d33 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:48.694272 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a72e40d8-fb7e-47d1-b859-aca4f6c58d33 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:48.696920 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a72e40d8-fb7e-47d1-b859-aca4f6c58d33 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:48.936181 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-a72e40d8-fb7e-47d1-b859-aca4f6c58d33 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:48.941520 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:36:48.950172 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-a72e40d8-fb7e-47d1-b859-aca4f6c58d33 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/d70d71f4-de27-4d62-acad-c6e9a7a7225e" status: 200 len: 1522 microversion: 2.1 time: 0.279473 Jul 28 05:36:48.951056 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 456/680] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:36:48 2022] GET /compute/v2.1/servers/d70d71f4-de27-4d62-acad-c6e9a7a7225e => generated 1522 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:36:48.972804 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-5d107032-b8bb-4e9a-9215-05a54b44a1c4 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:48.975166 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-5d107032-b8bb-4e9a-9215-05a54b44a1c4 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] [instance: 549e692f-7b6f-4ab0-987b-986a1934630e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:48.991039 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5d107032-b8bb-4e9a-9215-05a54b44a1c4 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:48.991792 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5d107032-b8bb-4e9a-9215-05a54b44a1c4 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:48.992845 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5d107032-b8bb-4e9a-9215-05a54b44a1c4 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:48.993704 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5d107032-b8bb-4e9a-9215-05a54b44a1c4 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:49.078383 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-5d107032-b8bb-4e9a-9215-05a54b44a1c4 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d859e797d874c948325f2ce0978edb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5989fabc615545eeb4ef987dea566175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:49.087940 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-5d107032-b8bb-4e9a-9215-05a54b44a1c4 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] 10.222.0.33 "GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e" status: 200 len: 1262 microversion: 2.1 time: 0.120923 Jul 28 05:36:49.119732 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 457/681] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:36:48 2022] GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e => generated 1262 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:36:49.211255 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-cdc9f655-c79c-46a0-b34f-6d0a6427f03c tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Action: 'create', calling method: .version_select at 0x7f25e02710d0>, body: {"keypair": {"name": "tempest-keypair-257450573", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANs8at+bqkDNcBs/uRGoH0KrXflQ6KaEJEJw4VCGSMhMcWqlcE7kpGyHmyqmko8RKfCJojYEUIJmHofq3c42LtAqQnBvn8b8nqXdvnSGkxouJFGse5lMN8HrVNzliAupw=="}} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:36:49.228822 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.quota [None req-cdc9f655-c79c-46a0-b34f-6d0a6427f03c tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Getting quotas for project 7b96e460476f4bc9b35224e38b33f4c7. Resources: {'key_pairs'} {{(pid=124482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 05:36:49.235704 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.quota [None req-cdc9f655-c79c-46a0-b34f-6d0a6427f03c tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Getting quotas for user b3c43b517c8a464c93f0ce620826ad35 and project 7b96e460476f4bc9b35224e38b33f4c7. Resources: {'key_pairs'} {{(pid=124482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 05:36:49.340292 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-cdc9f655-c79c-46a0-b34f-6d0a6427f03c tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.132906 Jul 28 05:36:49.341550 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 458/682] 10.222.0.33 () {60 vars in 1159 bytes} [Thu Jul 28 05:36:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 05:36:49.973904 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-26105c63-b72d-453a-9fcb-89579eae8611 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:49.974660 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-26105c63-b72d-453a-9fcb-89579eae8611 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: d70d71f4-de27-4d62-acad-c6e9a7a7225e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:49.983790 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-26105c63-b72d-453a-9fcb-89579eae8611 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:49.988231 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-26105c63-b72d-453a-9fcb-89579eae8611 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:49.988231 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-26105c63-b72d-453a-9fcb-89579eae8611 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:49.988231 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-26105c63-b72d-453a-9fcb-89579eae8611 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:50.284926 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-26105c63-b72d-453a-9fcb-89579eae8611 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:50.295659 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-26105c63-b72d-453a-9fcb-89579eae8611 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/d70d71f4-de27-4d62-acad-c6e9a7a7225e" status: 200 len: 1522 microversion: 2.1 time: 0.326015 Jul 28 05:36:50.309672 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 459/683] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:36:49 2022] GET /compute/v2.1/servers/d70d71f4-de27-4d62-acad-c6e9a7a7225e => generated 1522 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:36:50.309672 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-657509cd-0425-461c-9f75-b53c7a3b39c1 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:50.309672 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-657509cd-0425-461c-9f75-b53c7a3b39c1 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] [instance: 549e692f-7b6f-4ab0-987b-986a1934630e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:50.323309 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-657509cd-0425-461c-9f75-b53c7a3b39c1 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:50.323701 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-657509cd-0425-461c-9f75-b53c7a3b39c1 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:50.334233 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-657509cd-0425-461c-9f75-b53c7a3b39c1 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:50.334741 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-657509cd-0425-461c-9f75-b53c7a3b39c1 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:50.485982 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-657509cd-0425-461c-9f75-b53c7a3b39c1 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d859e797d874c948325f2ce0978edb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5989fabc615545eeb4ef987dea566175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:50.494291 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-657509cd-0425-461c-9f75-b53c7a3b39c1 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] 10.222.0.33 "GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e" status: 200 len: 1310 microversion: 2.1 time: 0.189464 Jul 28 05:36:50.494865 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 460/684] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:36:50 2022] GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e => generated 1310 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:36:51.093103 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-d2f76536-3be1-4012-a85f-bac2f128d7ae req-9b61b29a-b878-4c13-a337-e40eef8cb996 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d70d71f4-de27-4d62-acad-c6e9a7a7225e", "name": "network-vif-deleted", "tag": "c16cb5d0-7376-4ff8-92fe-2ea79594b837"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:36:51.119276 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-d2f76536-3be1-4012-a85f-bac2f128d7ae req-9b61b29a-b878-4c13-a337-e40eef8cb996 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:51.119796 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-d2f76536-3be1-4012-a85f-bac2f128d7ae req-9b61b29a-b878-4c13-a337-e40eef8cb996 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:51.141106 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-d2f76536-3be1-4012-a85f-bac2f128d7ae req-9b61b29a-b878-4c13-a337-e40eef8cb996 service nova] Creating event network-vif-deleted:c16cb5d0-7376-4ff8-92fe-2ea79594b837 for instance d70d71f4-de27-4d62-acad-c6e9a7a7225e on hv-cinder-79987 Jul 28 05:36:51.146674 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-d2f76536-3be1-4012-a85f-bac2f128d7ae req-9b61b29a-b878-4c13-a337-e40eef8cb996 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058076 Jul 28 05:36:51.147742 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 461/685] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:36:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 05:36:51.336971 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-bedb8a59-81b5-4e4d-8f9c-3195430d099d tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:51.336971 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-bedb8a59-81b5-4e4d-8f9c-3195430d099d tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: d70d71f4-de27-4d62-acad-c6e9a7a7225e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:51.347406 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-bedb8a59-81b5-4e4d-8f9c-3195430d099d tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:51.347863 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-bedb8a59-81b5-4e4d-8f9c-3195430d099d tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:51.348654 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-bedb8a59-81b5-4e4d-8f9c-3195430d099d tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:51.349100 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-bedb8a59-81b5-4e4d-8f9c-3195430d099d tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:51.419797 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-bedb8a59-81b5-4e4d-8f9c-3195430d099d tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:51.428909 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-bedb8a59-81b5-4e4d-8f9c-3195430d099d tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/d70d71f4-de27-4d62-acad-c6e9a7a7225e" status: 200 len: 1307 microversion: 2.1 time: 0.110485 Jul 28 05:36:51.429914 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 462/686] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:36:51 2022] GET /compute/v2.1/servers/d70d71f4-de27-4d62-acad-c6e9a7a7225e => generated 1307 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:36:51.521001 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-bbd351df-5b82-41c5-b515-21a289d3caa5 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:51.522047 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-bbd351df-5b82-41c5-b515-21a289d3caa5 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] [instance: 549e692f-7b6f-4ab0-987b-986a1934630e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:51.539600 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-bbd351df-5b82-41c5-b515-21a289d3caa5 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:51.540602 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-bbd351df-5b82-41c5-b515-21a289d3caa5 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:51.541918 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-bbd351df-5b82-41c5-b515-21a289d3caa5 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:51.542527 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-bbd351df-5b82-41c5-b515-21a289d3caa5 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:51.618987 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-bbd351df-5b82-41c5-b515-21a289d3caa5 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d859e797d874c948325f2ce0978edb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5989fabc615545eeb4ef987dea566175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:51.629069 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-bbd351df-5b82-41c5-b515-21a289d3caa5 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] 10.222.0.33 "GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e" status: 200 len: 1328 microversion: 2.1 time: 0.111895 Jul 28 05:36:51.634526 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 463/687] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:36:51 2022] GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e => generated 1328 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:36:52.392367 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-a1d67c8c-9dbd-41fe-8d3f-81800cd1a249 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "94b9b7b8-95d0-4908-b86d-bd7ce54d93d9"}} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:36:52.395777 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-a1d67c8c-9dbd-41fe-8d3f-81800cd1a249 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: b9162e60-7996-4d4d-964f-6844383357b6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:52.409580 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a1d67c8c-9dbd-41fe-8d3f-81800cd1a249 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:52.416490 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a1d67c8c-9dbd-41fe-8d3f-81800cd1a249 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:52.421634 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a1d67c8c-9dbd-41fe-8d3f-81800cd1a249 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:52.422098 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a1d67c8c-9dbd-41fe-8d3f-81800cd1a249 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:52.571557 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.wsgi [None req-a1d67c8c-9dbd-41fe-8d3f-81800cd1a249 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] HTTP exception thrown: Invalid volume: volume 94b9b7b8-95d0-4908-b86d-bd7ce54d93d9 is already attached to instances: b9162e60-7996-4d4d-964f-6844383357b6 Jul 28 05:36:52.576742 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-a1d67c8c-9dbd-41fe-8d3f-81800cd1a249 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Request method failure captured: Jul 28 05:36:52.576742 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: request: POST /compute/v2.1/servers/b9162e60-7996-4d4d-964f-6844383357b6/os-volume_attachments HTTP/1.1 Jul 28 05:36:52.576742 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept: application/json Jul 28 05:36:52.576742 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept-Encoding: identity Jul 28 05:36:52.576742 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Connection: close Jul 28 05:36:52.576742 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Length: 74 Jul 28 05:36:52.576742 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Type: application/json Jul 28 05:36:52.576742 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Host: 10.222.0.33 Jul 28 05:36:52.576742 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Openstack-System-Scope: None Jul 28 05:36:52.576742 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: User-Agent: python-urllib3/1.26.10 Jul 28 05:36:52.576742 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Auth-Token: gAAAAABi4h9D_G9i011T28yIc-ZNvejV_UpI0QoKlXE0FGZ91QFBkrT7qoFtXVHh-pu6aHMGmM56LTiBsS724USe_vuB1sVPXPQos6zopSWxHNIiTv0vnR9zJg55cl6dG7-t6mrt4b6a18Xfa5nEVVolwB-FkmudbFUJziZU1gufozNL3J-fAhg Jul 28 05:36:52.576742 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Id: None Jul 28 05:36:52.576742 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Name: None Jul 28 05:36:52.576742 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Identity-Status: Confirmed Jul 28 05:36:52.576742 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Is-Admin-Project: True Jul 28 05:36:52.576742 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Id: default Jul 28 05:36:52.576742 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Name: Default Jul 28 05:36:52.576742 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Id: ba0b7f7639504a25a73c94335d62b98f Jul 28 05:36:52.576742 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Name: tempest-AttachVolumeNegativeTest-1557602675 Jul 28 05:36:52.576742 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Role: member,reader Jul 28 05:36:52.576742 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Roles: member,reader Jul 28 05:36:52.578413 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ba0b7f7639504a25a73c94335d62b98f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ba0b7f7639504a25a73c94335d62b98f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ba0b7f7639504a25a73c94335d62b98f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ba0b7f7639504a25a73c94335d62b98f"}]}] Jul 28 05:36:52.578413 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant: tempest-AttachVolumeNegativeTest-1557602675 Jul 28 05:36:52.578413 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Id: ba0b7f7639504a25a73c94335d62b98f Jul 28 05:36:52.578413 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1557602675 Jul 28 05:36:52.578413 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User: tempest-AttachVolumeNegativeTest-1557602675-project Jul 28 05:36:52.578413 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Id: default Jul 28 05:36:52.578413 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Name: Default Jul 28 05:36:52.578413 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Id: 0002ebbc629b4dafb109dc94450fe1d8 Jul 28 05:36:52.578413 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Name: tempest-AttachVolumeNegativeTest-1557602675-project Jul 28 05:36:52.578413 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Jul 28 05:36:52.578413 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: {"volumeAttachment": {"volumeId": "94b9b7b8-95d0-4908-b86d-bd7ce54d93d9"}} Jul 28 05:36:52.578413 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: method: > Jul 28 05:36:52.579269 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: exception: Invalid volume: volume 94b9b7b8-95d0-4908-b86d-bd7ce54d93d9 is already attached to instances: b9162e60-7996-4d4d-964f-6844383357b6 Jul 28 05:36:52.579269 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: action_args: {'server_id': 'b9162e60-7996-4d4d-964f-6844383357b6', 'body': {'volumeAttachment': {'volumeId': '94b9b7b8-95d0-4908-b86d-bd7ce54d93d9'}}} Jul 28 05:36:52.579269 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 05:36:52.579269 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:36:52.579269 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 28 05:36:52.579269 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 28 05:36:52.579269 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 05:36:52.579269 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 05:36:52.579269 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 28 05:36:52.579269 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 05:36:52.579269 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5067, in attach_volume Jul 28 05:36:52.579269 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 28 05:36:52.579269 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4907, in _check_volume_already_attached Jul 28 05:36:52.579269 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 28 05:36:52.579269 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 94b9b7b8-95d0-4908-b86d-bd7ce54d93d9 is already attached to instances: b9162e60-7996-4d4d-964f-6844383357b6 Jul 28 05:36:52.579269 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:36:52.579269 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:36:52.579269 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:36:52.579269 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:36:52.580428 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:36:52.580428 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:36:52.580428 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 05:36:52.580428 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 05:36:52.580428 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 05:36:52.580428 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:36:52.580428 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 05:36:52.580428 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 05:36:52.580428 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 05:36:52.580428 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 05:36:52.580428 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 05:36:52.580428 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 05:36:52.580428 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 28 05:36:52.580428 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 28 05:36:52.580428 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 94b9b7b8-95d0-4908-b86d-bd7ce54d93d9 is already attached to instances: b9162e60-7996-4d4d-964f-6844383357b6 Jul 28 05:36:52.580428 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:36:52.580428 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:36:52.580428 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:36:52.580428 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:36:52.580428 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:36:52.582567 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:36:52.582567 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 05:36:52.582567 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 05:36:52.582567 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 94b9b7b8-95d0-4908-b86d-bd7ce54d93d9 is already attached to instances: b9162e60-7996-4d4d-964f-6844383357b6 Jul 28 05:36:52.582567 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:36:52.582567 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-a1d67c8c-9dbd-41fe-8d3f-81800cd1a249 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Returning 400 to user: Invalid volume: volume 94b9b7b8-95d0-4908-b86d-bd7ce54d93d9 is already attached to instances: b9162e60-7996-4d4d-964f-6844383357b6 {{(pid=124482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 05:36:52.582567 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-a1d67c8c-9dbd-41fe-8d3f-81800cd1a249 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "POST /compute/v2.1/servers/b9162e60-7996-4d4d-964f-6844383357b6/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.187839 Jul 28 05:36:52.594565 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 464/688] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Jul 28 05:36:52 2022] POST /compute/v2.1/servers/b9162e60-7996-4d4d-964f-6844383357b6/os-volume_attachments => generated 174 bytes in 207 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 05:36:52.604763 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-a0e910fb-7ac9-472c-ad63-8253fc5b8d19 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:52.608812 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-a0e910fb-7ac9-472c-ad63-8253fc5b8d19 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: d70d71f4-de27-4d62-acad-c6e9a7a7225e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:52.629049 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a0e910fb-7ac9-472c-ad63-8253fc5b8d19 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:52.632240 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a0e910fb-7ac9-472c-ad63-8253fc5b8d19 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:52.635024 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a0e910fb-7ac9-472c-ad63-8253fc5b8d19 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:52.637655 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a0e910fb-7ac9-472c-ad63-8253fc5b8d19 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:52.704357 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a0e910fb-7ac9-472c-ad63-8253fc5b8d19 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:52.704777 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a0e910fb-7ac9-472c-ad63-8253fc5b8d19 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:52.705234 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.objects.instance [None req-a0e910fb-7ac9-472c-ad63-8253fc5b8d19 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lazy-loading 'fault' on Instance uuid d70d71f4-de27-4d62-acad-c6e9a7a7225e {{(pid=124482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 05:36:52.752842 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-a0e910fb-7ac9-472c-ad63-8253fc5b8d19 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fcc81558e8f4224ad2ea6fb2b7bf0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f094bca18d4939bb22f8d076d3a35c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:52.774912 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-a0e910fb-7ac9-472c-ad63-8253fc5b8d19 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/d70d71f4-de27-4d62-acad-c6e9a7a7225e" status: 200 len: 1312 microversion: 2.1 time: 0.163839 Jul 28 05:36:52.780827 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 465/689] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:36:52 2022] GET /compute/v2.1/servers/d70d71f4-de27-4d62-acad-c6e9a7a7225e => generated 1312 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:36:52.799005 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-5781deb4-778c-45b3-8e43-7f10faae4cca tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:52.800121 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-5781deb4-778c-45b3-8e43-7f10faae4cca tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] [instance: 549e692f-7b6f-4ab0-987b-986a1934630e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:52.807425 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5781deb4-778c-45b3-8e43-7f10faae4cca tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:52.809039 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5781deb4-778c-45b3-8e43-7f10faae4cca tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:52.812300 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5781deb4-778c-45b3-8e43-7f10faae4cca tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:52.813021 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5781deb4-778c-45b3-8e43-7f10faae4cca tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:53.007316 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-5781deb4-778c-45b3-8e43-7f10faae4cca tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d859e797d874c948325f2ce0978edb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5989fabc615545eeb4ef987dea566175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:53.015927 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-5781deb4-778c-45b3-8e43-7f10faae4cca tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] 10.222.0.33 "GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e" status: 200 len: 1358 microversion: 2.1 time: 0.233669 Jul 28 05:36:53.016838 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 466/690] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:36:52 2022] GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e => generated 1358 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:36:53.036018 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-55943602-db11-431a-8321-a10a1a6a7b2c tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:53.040312 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-55943602-db11-431a-8321-a10a1a6a7b2c tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: b9162e60-7996-4d4d-964f-6844383357b6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:53.046412 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-55943602-db11-431a-8321-a10a1a6a7b2c tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:53.047107 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-55943602-db11-431a-8321-a10a1a6a7b2c tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:53.053107 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-55943602-db11-431a-8321-a10a1a6a7b2c tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:53.053822 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-55943602-db11-431a-8321-a10a1a6a7b2c tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:53.206838 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.objects.instance [None req-55943602-db11-431a-8321-a10a1a6a7b2c tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lazy-loading 'services' on Instance uuid b9162e60-7996-4d4d-964f-6844383357b6 {{(pid=124482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 05:36:53.452683 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-55943602-db11-431a-8321-a10a1a6a7b2c tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b9162e60-7996-4d4d-964f-6844383357b6/os-volume_attachments/94b9b7b8-95d0-4908-b86d-bd7ce54d93d9" status: 202 len: 0 microversion: 2.1 time: 0.421368 Jul 28 05:36:53.453407 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 467/691] 10.222.0.33 () {58 vars in 1416 bytes} [Thu Jul 28 05:36:53 2022] DELETE /compute/v2.1/servers/b9162e60-7996-4d4d-964f-6844383357b6/os-volume_attachments/94b9b7b8-95d0-4908-b86d-bd7ce54d93d9 => generated 0 bytes in 423 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 05:36:53.459357 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-4fab235f-b918-482a-8492-becef682102d tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1408016119", "imageRef": "4f0ce061-6677-4c2a-9ee1-54a100f21462", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "92779e58-7df4-4404-9045-ca3676cbb72b"}], "security_groups": [{"name": "tempest-securitygroup--1219789748"}], "key_name": "tempest-keypair-257450573", "user_data": "}} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:36:57.083029 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.network.neutron [None req-4fab235f-b918-482a-8492-becef682102d tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] validate_networks() for [('92779e58-7df4-4404-9045-ca3676cbb72b', None, None, None, None, None)] {{(pid=124482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 05:36:57.255554 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell0:SELECT=2 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:36:57.473593 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-4fab235f-b918-482a-8492-becef682102d tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Flavor limits 0:0:0 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 05:36:57.474018 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-4fab235f-b918-482a-8492-becef682102d tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Image limits 0:0:0 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 05:36:57.474480 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-4fab235f-b918-482a-8492-becef682102d tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Flavor pref 0:0:0 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 05:36:57.475036 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-4fab235f-b918-482a-8492-becef682102d tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Image pref 0:0:0 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 05:36:57.475463 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-4fab235f-b918-482a-8492-becef682102d tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 05:36:57.485766 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4fab235f-b918-482a-8492-becef682102d tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:57.487871 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4fab235f-b918-482a-8492-becef682102d tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:57.488755 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4fab235f-b918-482a-8492-becef682102d tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:57.489239 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4fab235f-b918-482a-8492-becef682102d tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:57.507230 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.quota [None req-4fab235f-b918-482a-8492-becef682102d tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Getting quotas for project 7b96e460476f4bc9b35224e38b33f4c7. Resources: {'ram', 'instances', 'cores'} {{(pid=124482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 05:36:57.511258 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.quota [None req-4fab235f-b918-482a-8492-becef682102d tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Getting quotas for user b3c43b517c8a464c93f0ce620826ad35 and project 7b96e460476f4bc9b35224e38b33f4c7. Resources: {'ram', 'instances', 'cores'} {{(pid=124482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 05:36:57.523562 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-4fab235f-b918-482a-8492-becef682102d tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Going to run 1 instances... {{(pid=124482) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 05:36:57.525975 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-4fab235f-b918-482a-8492-becef682102d tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: b4c59c70-b18e-4e7d-ad59-50b0e2e66041] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f0ce061-6677-4c2a-9ee1-54a100f21462',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 05:36:57.681787 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-4fab235f-b918-482a-8492-becef682102d tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.226989 Jul 28 05:36:57.746207 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 468/692] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Jul 28 05:36:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 4229 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 05:36:57.746207 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-7f85fad9-cb70-44fb-9a35-7c2664443cb0 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:57.746207 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-7f85fad9-cb70-44fb-9a35-7c2664443cb0 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: b9162e60-7996-4d4d-964f-6844383357b6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:57.746207 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7f85fad9-cb70-44fb-9a35-7c2664443cb0 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:57.746531 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7f85fad9-cb70-44fb-9a35-7c2664443cb0 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:57.746531 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7f85fad9-cb70-44fb-9a35-7c2664443cb0 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:57.746531 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7f85fad9-cb70-44fb-9a35-7c2664443cb0 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:57.746531 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-7f85fad9-cb70-44fb-9a35-7c2664443cb0 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/b9162e60-7996-4d4d-964f-6844383357b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051991 Jul 28 05:36:57.746986 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 469/693] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Jul 28 05:36:57 2022] GET /compute/v2.1/servers/b9162e60-7996-4d4d-964f-6844383357b6/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:36:57.746986 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-8c0a0ab0-5845-4083-bf1b-a66aa1aedbe3 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:57.746986 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-8c0a0ab0-5845-4083-bf1b-a66aa1aedbe3 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] [instance: d70d71f4-de27-4d62-acad-c6e9a7a7225e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:57.759776 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8c0a0ab0-5845-4083-bf1b-a66aa1aedbe3 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:57.791354 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8c0a0ab0-5845-4083-bf1b-a66aa1aedbe3 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:57.791354 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8c0a0ab0-5845-4083-bf1b-a66aa1aedbe3 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:57.791354 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8c0a0ab0-5845-4083-bf1b-a66aa1aedbe3 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:57.791354 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.wsgi [None req-8c0a0ab0-5845-4083-bf1b-a66aa1aedbe3 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] HTTP exception thrown: Instance d70d71f4-de27-4d62-acad-c6e9a7a7225e could not be found. Jul 28 05:36:57.792822 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-8c0a0ab0-5845-4083-bf1b-a66aa1aedbe3 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Request method failure captured: Jul 28 05:36:57.792822 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: request: GET /compute/v2.1/servers/d70d71f4-de27-4d62-acad-c6e9a7a7225e HTTP/1.1 Jul 28 05:36:57.792822 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept: application/json Jul 28 05:36:57.792822 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept-Encoding: identity Jul 28 05:36:57.792822 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Connection: close Jul 28 05:36:57.792822 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Length: 0 Jul 28 05:36:57.792822 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Type: application/json Jul 28 05:36:57.792822 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Host: 10.222.0.33 Jul 28 05:36:57.792822 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Openstack-System-Scope: None Jul 28 05:36:57.792822 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: User-Agent: python-urllib3/1.26.10 Jul 28 05:36:57.792822 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Auth-Token: gAAAAABi4h84wg4qlFIi1MM6witAk51FDE4BLzXqxMfe6k0jq8CFmcbtqdoBS3AevDrKaw3dmOujUkImtAsInpNCwgYRxMei_nfojXNroWNTr6vsZakpdR__3W76-XDu4xyFhZj-aUFliI2k9fmeYH-hK9oTm36uOAQrbt51a7XSRrj7_QKgyu0 Jul 28 05:36:57.792822 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Id: None Jul 28 05:36:57.792822 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Name: None Jul 28 05:36:57.792822 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Identity-Status: Confirmed Jul 28 05:36:57.792822 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Is-Admin-Project: True Jul 28 05:36:57.792822 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Id: default Jul 28 05:36:57.792822 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Name: Default Jul 28 05:36:57.792822 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Id: 99f094bca18d4939bb22f8d076d3a35c Jul 28 05:36:57.792822 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1728283555 Jul 28 05:36:57.792822 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Role: member,reader Jul 28 05:36:57.792822 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Roles: member,reader Jul 28 05:36:57.794118 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/99f094bca18d4939bb22f8d076d3a35c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/99f094bca18d4939bb22f8d076d3a35c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_99f094bca18d4939bb22f8d076d3a35c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/99f094bca18d4939bb22f8d076d3a35c"}]}] Jul 28 05:36:57.794118 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1728283555 Jul 28 05:36:57.794118 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Id: 99f094bca18d4939bb22f8d076d3a35c Jul 28 05:36:57.794118 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1728283555 Jul 28 05:36:57.794118 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User: tempest-ServerRescueNegativeTestJSON-1728283555-project Jul 28 05:36:57.794118 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Id: default Jul 28 05:36:57.794118 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Name: Default Jul 28 05:36:57.794118 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Id: 4fcc81558e8f4224ad2ea6fb2b7bf0f9 Jul 28 05:36:57.794118 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1728283555-project Jul 28 05:36:57.794118 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: method: > Jul 28 05:36:57.794118 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: exception: Instance d70d71f4-de27-4d62-acad-c6e9a7a7225e could not be found. Jul 28 05:36:57.794118 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: action_args: {'id': 'd70d71f4-de27-4d62-acad-c6e9a7a7225e'} Jul 28 05:36:57.795025 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 05:36:57.795025 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:36:57.795025 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 05:36:57.795025 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 05:36:57.795025 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 05:36:57.795025 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 05:36:57.795025 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 05:36:57.795025 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 05:36:57.795025 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 05:36:57.795025 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 05:36:57.795025 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d70d71f4-de27-4d62-acad-c6e9a7a7225e could not be found. Jul 28 05:36:57.795025 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:36:57.795025 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:36:57.795025 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:36:57.795025 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:36:57.795025 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:36:57.795025 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:36:57.795025 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 05:36:57.795025 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 05:36:57.795025 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 05:36:57.796436 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:36:57.796436 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 05:36:57.796436 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 05:36:57.796436 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 05:36:57.796436 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 05:36:57.796436 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 05:36:57.796436 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 05:36:57.796436 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d70d71f4-de27-4d62-acad-c6e9a7a7225e could not be found. Jul 28 05:36:57.796436 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:36:57.796436 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:36:57.796436 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:36:57.796436 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:36:57.796436 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:36:57.796436 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:36:57.796436 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 05:36:57.796436 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 05:36:57.796436 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d70d71f4-de27-4d62-acad-c6e9a7a7225e could not be found. Jul 28 05:36:57.796436 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:36:57.798880 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-8c0a0ab0-5845-4083-bf1b-a66aa1aedbe3 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] Returning 404 to user: Instance d70d71f4-de27-4d62-acad-c6e9a7a7225e could not be found. {{(pid=124482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 05:36:57.798880 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-8c0a0ab0-5845-4083-bf1b-a66aa1aedbe3 tempest-ServerRescueNegativeTestJSON-1728283555 tempest-ServerRescueNegativeTestJSON-1728283555-project] 10.222.0.33 "GET /compute/v2.1/servers/d70d71f4-de27-4d62-acad-c6e9a7a7225e" status: 404 len: 111 microversion: 2.1 time: 0.039976 Jul 28 05:36:57.798880 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 470/694] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:36:57 2022] GET /compute/v2.1/servers/d70d71f4-de27-4d62-acad-c6e9a7a7225e => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 05:36:57.798880 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-75e06d88-5fd1-4e05-badd-786d83ec3e5f tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:57.798880 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-75e06d88-5fd1-4e05-badd-786d83ec3e5f tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] [instance: 549e692f-7b6f-4ab0-987b-986a1934630e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:57.814163 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-75e06d88-5fd1-4e05-badd-786d83ec3e5f tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:57.814753 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-75e06d88-5fd1-4e05-badd-786d83ec3e5f tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:57.815865 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-75e06d88-5fd1-4e05-badd-786d83ec3e5f tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:57.816575 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-75e06d88-5fd1-4e05-badd-786d83ec3e5f tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:58.034041 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-75e06d88-5fd1-4e05-badd-786d83ec3e5f tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d859e797d874c948325f2ce0978edb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5989fabc615545eeb4ef987dea566175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:58.054780 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-75e06d88-5fd1-4e05-badd-786d83ec3e5f tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] 10.222.0.33 "GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e" status: 200 len: 1358 microversion: 2.1 time: 0.273249 Jul 28 05:36:58.069515 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 471/695] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:36:57 2022] GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e => generated 1358 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:36:58.069515 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-df4f1237-f1d2-4841-b02a-910a97db19eb req-f9d0ca1b-73c3-4522-8e50-603421316cc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "549e692f-7b6f-4ab0-987b-986a1934630e", "tag": "b49100c3-29f8-45db-910f-805da59e6250"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:36:58.096348 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-df4f1237-f1d2-4841-b02a-910a97db19eb req-f9d0ca1b-73c3-4522-8e50-603421316cc5 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:58.097453 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-df4f1237-f1d2-4841-b02a-910a97db19eb req-f9d0ca1b-73c3-4522-8e50-603421316cc5 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:58.113530 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-df4f1237-f1d2-4841-b02a-910a97db19eb req-f9d0ca1b-73c3-4522-8e50-603421316cc5 service nova] Creating event network-changed:b49100c3-29f8-45db-910f-805da59e6250 for instance 549e692f-7b6f-4ab0-987b-986a1934630e on hv-cinder-79987 Jul 28 05:36:58.119178 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-df4f1237-f1d2-4841-b02a-910a97db19eb req-f9d0ca1b-73c3-4522-8e50-603421316cc5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058273 Jul 28 05:36:58.121187 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 472/696] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:36:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:36:58.320975 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-3f6849c0-12f2-4f53-b969-76be30bf7f6e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:58.321687 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-3f6849c0-12f2-4f53-b969-76be30bf7f6e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:58.332479 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3f6849c0-12f2-4f53-b969-76be30bf7f6e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:58.335966 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3f6849c0-12f2-4f53-b969-76be30bf7f6e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:58.337415 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3f6849c0-12f2-4f53-b969-76be30bf7f6e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:58.341529 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3f6849c0-12f2-4f53-b969-76be30bf7f6e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:58.385607 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-3f6849c0-12f2-4f53-b969-76be30bf7f6e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6/ips" status: 200 len: 153 microversion: 2.20 time: 0.262584 Jul 28 05:36:58.386891 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 473/697] 10.222.0.33 () {60 vars in 1289 bytes} [Thu Jul 28 05:36:58 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6/ips => generated 153 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 05:36:58.399871 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-ed6d10de-35a4-40d6-b995-8a3fbc451a9f tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:58.410026 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-ed6d10de-35a4-40d6-b995-8a3fbc451a9f tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: b4c59c70-b18e-4e7d-ad59-50b0e2e66041] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:58.479305 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-ed6d10de-35a4-40d6-b995-8a3fbc451a9f tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:58.488698 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-ed6d10de-35a4-40d6-b995-8a3fbc451a9f tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041" status: 200 len: 1237 microversion: 2.1 time: 0.100438 Jul 28 05:36:58.489868 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 474/698] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:36:58 2022] GET /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041 => generated 1237 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:36:58.754117 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-b4f07c9b-4188-4a67-b3ad-eebdf119efaa tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:58.756390 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-b4f07c9b-4188-4a67-b3ad-eebdf119efaa tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: b9162e60-7996-4d4d-964f-6844383357b6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:58.760104 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:36:58.777350 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b4f07c9b-4188-4a67-b3ad-eebdf119efaa tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:58.777803 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b4f07c9b-4188-4a67-b3ad-eebdf119efaa tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:58.778520 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b4f07c9b-4188-4a67-b3ad-eebdf119efaa tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:58.779873 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b4f07c9b-4188-4a67-b3ad-eebdf119efaa tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:58.826566 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-b4f07c9b-4188-4a67-b3ad-eebdf119efaa tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/b9162e60-7996-4d4d-964f-6844383357b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077350 Jul 28 05:36:58.827473 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 475/699] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Jul 28 05:36:58 2022] GET /compute/v2.1/servers/b9162e60-7996-4d4d-964f-6844383357b6/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:36:59.094003 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-eb8a5833-25ab-4e56-98d1-32cc04aa8a03 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:59.094767 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-eb8a5833-25ab-4e56-98d1-32cc04aa8a03 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] [instance: 549e692f-7b6f-4ab0-987b-986a1934630e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:59.118173 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-eb8a5833-25ab-4e56-98d1-32cc04aa8a03 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:59.118888 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-eb8a5833-25ab-4e56-98d1-32cc04aa8a03 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:59.140656 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-eb8a5833-25ab-4e56-98d1-32cc04aa8a03 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:59.141320 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-eb8a5833-25ab-4e56-98d1-32cc04aa8a03 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:59.376996 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-eb8a5833-25ab-4e56-98d1-32cc04aa8a03 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d859e797d874c948325f2ce0978edb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5989fabc615545eeb4ef987dea566175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:59.394568 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-eb8a5833-25ab-4e56-98d1-32cc04aa8a03 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] 10.222.0.33 "GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e" status: 200 len: 1358 microversion: 2.1 time: 0.306478 Jul 28 05:36:59.411614 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 476/700] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:36:59 2022] GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e => generated 1358 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:36:59.511280 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-c12f808a-8b1b-49a5-b56c-368fe57c3b99 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:59.512022 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-c12f808a-8b1b-49a5-b56c-368fe57c3b99 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: b4c59c70-b18e-4e7d-ad59-50b0e2e66041] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:59.533206 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c12f808a-8b1b-49a5-b56c-368fe57c3b99 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:59.533975 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c12f808a-8b1b-49a5-b56c-368fe57c3b99 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:59.534973 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c12f808a-8b1b-49a5-b56c-368fe57c3b99 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:59.535419 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c12f808a-8b1b-49a5-b56c-368fe57c3b99 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:59.579499 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:36:59.643777 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-c12f808a-8b1b-49a5-b56c-368fe57c3b99 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:36:59.654580 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-c12f808a-8b1b-49a5-b56c-368fe57c3b99 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041" status: 200 len: 1241 microversion: 2.1 time: 0.148390 Jul 28 05:36:59.655384 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 477/701] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:36:59 2022] GET /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041 => generated 1241 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:36:59.839692 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-155d3a9b-9e2e-405d-a390-0acafa5920fb tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:36:59.842671 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-155d3a9b-9e2e-405d-a390-0acafa5920fb tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: b9162e60-7996-4d4d-964f-6844383357b6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:36:59.848884 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-155d3a9b-9e2e-405d-a390-0acafa5920fb tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:59.849336 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-155d3a9b-9e2e-405d-a390-0acafa5920fb tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:59.850204 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-155d3a9b-9e2e-405d-a390-0acafa5920fb tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:36:59.850724 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-155d3a9b-9e2e-405d-a390-0acafa5920fb tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:36:59.885226 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-155d3a9b-9e2e-405d-a390-0acafa5920fb tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/b9162e60-7996-4d4d-964f-6844383357b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049480 Jul 28 05:36:59.885893 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 478/702] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Jul 28 05:36:59 2022] GET /compute/v2.1/servers/b9162e60-7996-4d4d-964f-6844383357b6/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 05:37:00.424825 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-08ca913f-359a-4c1d-a6e6-a6bd246e8277 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:00.425596 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-08ca913f-359a-4c1d-a6e6-a6bd246e8277 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] [instance: 549e692f-7b6f-4ab0-987b-986a1934630e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:00.434350 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-08ca913f-359a-4c1d-a6e6-a6bd246e8277 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:00.436960 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-08ca913f-359a-4c1d-a6e6-a6bd246e8277 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:00.436960 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-08ca913f-359a-4c1d-a6e6-a6bd246e8277 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:00.437149 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-08ca913f-359a-4c1d-a6e6-a6bd246e8277 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:00.773784 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-08ca913f-359a-4c1d-a6e6-a6bd246e8277 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d859e797d874c948325f2ce0978edb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5989fabc615545eeb4ef987dea566175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:00.786753 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-08ca913f-359a-4c1d-a6e6-a6bd246e8277 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] 10.222.0.33 "GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e" status: 200 len: 1358 microversion: 2.1 time: 0.367186 Jul 28 05:37:00.795731 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 479/703] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:37:00 2022] GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e => generated 1358 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:37:00.811704 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-976f4032-93f1-4242-a03d-0c7248ab2053 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:00.819877 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-976f4032-93f1-4242-a03d-0c7248ab2053 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: b4c59c70-b18e-4e7d-ad59-50b0e2e66041] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:00.822245 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-976f4032-93f1-4242-a03d-0c7248ab2053 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:00.822805 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-976f4032-93f1-4242-a03d-0c7248ab2053 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:00.823764 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-976f4032-93f1-4242-a03d-0c7248ab2053 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:00.824256 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-976f4032-93f1-4242-a03d-0c7248ab2053 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:00.918621 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-976f4032-93f1-4242-a03d-0c7248ab2053 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:00.954194 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-976f4032-93f1-4242-a03d-0c7248ab2053 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041" status: 200 len: 1233 microversion: 2.1 time: 0.153470 Jul 28 05:37:00.956837 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 480/704] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:37:00 2022] GET /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041 => generated 1233 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:37:00.971817 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-6ac79175-bc15-4dd6-90d2-d218d5bfd77b tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:00.975366 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-6ac79175-bc15-4dd6-90d2-d218d5bfd77b tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: b9162e60-7996-4d4d-964f-6844383357b6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:00.995371 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-6ac79175-bc15-4dd6-90d2-d218d5bfd77b tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:00.995983 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-6ac79175-bc15-4dd6-90d2-d218d5bfd77b tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:00.996916 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-6ac79175-bc15-4dd6-90d2-d218d5bfd77b tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:00.998027 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-6ac79175-bc15-4dd6-90d2-d218d5bfd77b tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:01.078742 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-6ac79175-bc15-4dd6-90d2-d218d5bfd77b tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/b9162e60-7996-4d4d-964f-6844383357b6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.120438 Jul 28 05:37:01.079772 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 481/705] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Jul 28 05:37:00 2022] GET /compute/v2.1/servers/b9162e60-7996-4d4d-964f-6844383357b6/os-volume_attachments => generated 25 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 05:37:01.103452 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-7b3ff132-6f92-4094-a697-8112d7072e88 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:37:01.105046 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-7b3ff132-6f92-4094-a697-8112d7072e88 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:01.117233 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7b3ff132-6f92-4094-a697-8112d7072e88 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:01.126048 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7b3ff132-6f92-4094-a697-8112d7072e88 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:01.129320 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7b3ff132-6f92-4094-a697-8112d7072e88 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:01.129320 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7b3ff132-6f92-4094-a697-8112d7072e88 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:01.185126 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.objects.instance [None req-7b3ff132-6f92-4094-a697-8112d7072e88 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lazy-loading 'flavor' on Instance uuid 54986322-1272-4f12-a108-b8675f3190a6 {{(pid=124482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 05:37:03.056973 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-7b3ff132-6f92-4094-a697-8112d7072e88 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "POST /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6/action" status: 202 len: 0 microversion: 2.20 time: 1.975173 Jul 28 05:37:03.065668 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 482/706] 10.222.0.33 () {62 vars in 1319 bytes} [Thu Jul 28 05:37:01 2022] POST /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6/action => generated 0 bytes in 1985 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 05:37:03.071656 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-8e75e438-94f3-4e90-918b-fe3978fb62db tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:03.072272 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-8e75e438-94f3-4e90-918b-fe3978fb62db tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: b9162e60-7996-4d4d-964f-6844383357b6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:03.083748 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8e75e438-94f3-4e90-918b-fe3978fb62db tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:03.083748 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8e75e438-94f3-4e90-918b-fe3978fb62db tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:03.083748 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8e75e438-94f3-4e90-918b-fe3978fb62db tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:03.083748 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8e75e438-94f3-4e90-918b-fe3978fb62db tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:03.116998 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-8e75e438-94f3-4e90-918b-fe3978fb62db tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: b9162e60-7996-4d4d-964f-6844383357b6] Going to try to terminate instance {{(pid=124482) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 05:37:03.502282 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-8e75e438-94f3-4e90-918b-fe3978fb62db tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b9162e60-7996-4d4d-964f-6844383357b6" status: 204 len: 0 microversion: 2.1 time: 0.434905 Jul 28 05:37:03.502979 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 483/707] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Jul 28 05:37:03 2022] DELETE /compute/v2.1/servers/b9162e60-7996-4d4d-964f-6844383357b6 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 05:37:03.508662 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-181ddfa1-51cf-4a86-9308-c2669d2876ab tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:03.510232 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-181ddfa1-51cf-4a86-9308-c2669d2876ab tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] [instance: 549e692f-7b6f-4ab0-987b-986a1934630e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:03.517419 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-181ddfa1-51cf-4a86-9308-c2669d2876ab tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:03.517898 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-181ddfa1-51cf-4a86-9308-c2669d2876ab tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:03.518667 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-181ddfa1-51cf-4a86-9308-c2669d2876ab tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:03.519102 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-181ddfa1-51cf-4a86-9308-c2669d2876ab tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:03.676246 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-181ddfa1-51cf-4a86-9308-c2669d2876ab tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d859e797d874c948325f2ce0978edb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5989fabc615545eeb4ef987dea566175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:03.683846 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-181ddfa1-51cf-4a86-9308-c2669d2876ab tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] 10.222.0.33 "GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e" status: 200 len: 1358 microversion: 2.1 time: 0.179564 Jul 28 05:37:03.684454 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 484/708] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:37:03 2022] GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:37:03.692027 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-7da4830a-7971-4cb6-9682-75bea4ec68cf tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:03.692027 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-7da4830a-7971-4cb6-9682-75bea4ec68cf tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: b4c59c70-b18e-4e7d-ad59-50b0e2e66041] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:03.698501 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7da4830a-7971-4cb6-9682-75bea4ec68cf tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:03.699048 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7da4830a-7971-4cb6-9682-75bea4ec68cf tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:03.699850 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7da4830a-7971-4cb6-9682-75bea4ec68cf tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:03.700306 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7da4830a-7971-4cb6-9682-75bea4ec68cf tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:03.773305 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-7da4830a-7971-4cb6-9682-75bea4ec68cf tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:03.782732 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-7da4830a-7971-4cb6-9682-75bea4ec68cf tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041" status: 200 len: 1297 microversion: 2.1 time: 0.096453 Jul 28 05:37:03.783363 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 485/709] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:37:03 2022] GET /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041 => generated 1297 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:37:03.788068 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-32fed695-b2dc-4063-93e6-522998667e0c tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:03.788684 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-32fed695-b2dc-4063-93e6-522998667e0c tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:03.795495 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-32fed695-b2dc-4063-93e6-522998667e0c tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:03.795949 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-32fed695-b2dc-4063-93e6-522998667e0c tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:03.796756 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-32fed695-b2dc-4063-93e6-522998667e0c tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:03.797193 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-32fed695-b2dc-4063-93e6-522998667e0c tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:03.931948 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-32fed695-b2dc-4063-93e6-522998667e0c tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:03.939866 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-32fed695-b2dc-4063-93e6-522998667e0c tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:03.941366 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-32fed695-b2dc-4063-93e6-522998667e0c tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:03.942570 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-32fed695-b2dc-4063-93e6-522998667e0c tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 200 len: 1725 microversion: 2.20 time: 0.158279 Jul 28 05:37:03.943131 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 486/710] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:37:03 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:37:03.947581 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-379b807e-084e-4036-8463-aa4338e295bf tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:03.948080 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-379b807e-084e-4036-8463-aa4338e295bf tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: b9162e60-7996-4d4d-964f-6844383357b6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:03.954460 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-379b807e-084e-4036-8463-aa4338e295bf tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:03.954908 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-379b807e-084e-4036-8463-aa4338e295bf tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:03.955671 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-379b807e-084e-4036-8463-aa4338e295bf tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:03.956108 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-379b807e-084e-4036-8463-aa4338e295bf tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:04.102221 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-379b807e-084e-4036-8463-aa4338e295bf tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:04.110547 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-379b807e-084e-4036-8463-aa4338e295bf tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/b9162e60-7996-4d4d-964f-6844383357b6" status: 200 len: 1684 microversion: 2.1 time: 0.166448 Jul 28 05:37:04.113273 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 487/711] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:37:03 2022] GET /compute/v2.1/servers/b9162e60-7996-4d4d-964f-6844383357b6 => generated 1684 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:37:04.705576 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-f443fbcf-2da8-4d42-8bfc-39ca7d2d53cc tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:04.706295 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-f443fbcf-2da8-4d42-8bfc-39ca7d2d53cc tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] [instance: 549e692f-7b6f-4ab0-987b-986a1934630e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:04.712894 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f443fbcf-2da8-4d42-8bfc-39ca7d2d53cc tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:04.713340 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f443fbcf-2da8-4d42-8bfc-39ca7d2d53cc tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:04.714147 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f443fbcf-2da8-4d42-8bfc-39ca7d2d53cc tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:04.714583 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f443fbcf-2da8-4d42-8bfc-39ca7d2d53cc tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:04.858003 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-f443fbcf-2da8-4d42-8bfc-39ca7d2d53cc tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d859e797d874c948325f2ce0978edb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5989fabc615545eeb4ef987dea566175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:04.866406 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-f443fbcf-2da8-4d42-8bfc-39ca7d2d53cc tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] 10.222.0.33 "GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e" status: 200 len: 1358 microversion: 2.1 time: 0.166096 Jul 28 05:37:04.867235 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 488/712] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:37:04 2022] GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:37:04.884772 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-b9fc1546-c16a-4ca1-8d94-3f1775100ea1 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:04.888513 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-b9fc1546-c16a-4ca1-8d94-3f1775100ea1 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: b4c59c70-b18e-4e7d-ad59-50b0e2e66041] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:04.898059 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b9fc1546-c16a-4ca1-8d94-3f1775100ea1 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:04.899629 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b9fc1546-c16a-4ca1-8d94-3f1775100ea1 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:04.900450 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b9fc1546-c16a-4ca1-8d94-3f1775100ea1 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:04.900881 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b9fc1546-c16a-4ca1-8d94-3f1775100ea1 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:04.994726 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-b9fc1546-c16a-4ca1-8d94-3f1775100ea1 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:05.004929 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-b9fc1546-c16a-4ca1-8d94-3f1775100ea1 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041" status: 200 len: 1307 microversion: 2.1 time: 0.125521 Jul 28 05:37:05.014796 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 489/713] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:37:04 2022] GET /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041 => generated 1307 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:37:05.024674 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-c67ea4b1-cf0b-4a1c-9236-35f043481178 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:05.026864 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-c67ea4b1-cf0b-4a1c-9236-35f043481178 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:05.035979 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c67ea4b1-cf0b-4a1c-9236-35f043481178 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:05.036524 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c67ea4b1-cf0b-4a1c-9236-35f043481178 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:05.037665 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c67ea4b1-cf0b-4a1c-9236-35f043481178 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:05.040124 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c67ea4b1-cf0b-4a1c-9236-35f043481178 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:05.058530 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:37:05.227191 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-c67ea4b1-cf0b-4a1c-9236-35f043481178 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:05.237303 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-c67ea4b1-cf0b-4a1c-9236-35f043481178 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:05.240491 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-c67ea4b1-cf0b-4a1c-9236-35f043481178 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:05.242252 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-c67ea4b1-cf0b-4a1c-9236-35f043481178 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 200 len: 1725 microversion: 2.20 time: 0.226185 Jul 28 05:37:05.246795 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 490/714] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:37:05 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 1725 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:37:05.259394 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-f2d9f477-12e4-45ef-85d3-4c0b7c021d0b tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:05.262149 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-f2d9f477-12e4-45ef-85d3-4c0b7c021d0b tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: b9162e60-7996-4d4d-964f-6844383357b6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:05.277732 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f2d9f477-12e4-45ef-85d3-4c0b7c021d0b tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:05.277732 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f2d9f477-12e4-45ef-85d3-4c0b7c021d0b tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:05.278464 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f2d9f477-12e4-45ef-85d3-4c0b7c021d0b tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:05.278908 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f2d9f477-12e4-45ef-85d3-4c0b7c021d0b tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:05.503938 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-f2d9f477-12e4-45ef-85d3-4c0b7c021d0b tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:05.518125 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-f2d9f477-12e4-45ef-85d3-4c0b7c021d0b tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/b9162e60-7996-4d4d-964f-6844383357b6" status: 200 len: 1684 microversion: 2.1 time: 0.265582 Jul 28 05:37:05.518125 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 491/715] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:37:05 2022] GET /compute/v2.1/servers/b9162e60-7996-4d4d-964f-6844383357b6 => generated 1684 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:37:05.892140 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-5e66d94e-0242-4f42-8c48-0ab5185fd8f6 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:05.895904 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-5e66d94e-0242-4f42-8c48-0ab5185fd8f6 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] [instance: 549e692f-7b6f-4ab0-987b-986a1934630e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:05.907388 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5e66d94e-0242-4f42-8c48-0ab5185fd8f6 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:05.910812 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5e66d94e-0242-4f42-8c48-0ab5185fd8f6 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:05.910812 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5e66d94e-0242-4f42-8c48-0ab5185fd8f6 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:05.910812 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5e66d94e-0242-4f42-8c48-0ab5185fd8f6 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:06.242186 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-5e66d94e-0242-4f42-8c48-0ab5185fd8f6 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d859e797d874c948325f2ce0978edb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5989fabc615545eeb4ef987dea566175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:06.258634 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-5e66d94e-0242-4f42-8c48-0ab5185fd8f6 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] 10.222.0.33 "GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e" status: 200 len: 1358 microversion: 2.1 time: 0.373678 Jul 28 05:37:06.262535 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 492/716] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:37:05 2022] GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e => generated 1358 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:37:06.273119 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-be31084d-1dc2-44b3-ae64-2e2788255306 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:06.274205 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-be31084d-1dc2-44b3-ae64-2e2788255306 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: b4c59c70-b18e-4e7d-ad59-50b0e2e66041] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:06.287775 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-be31084d-1dc2-44b3-ae64-2e2788255306 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:06.288575 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-be31084d-1dc2-44b3-ae64-2e2788255306 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:06.289635 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-be31084d-1dc2-44b3-ae64-2e2788255306 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:06.290303 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-be31084d-1dc2-44b3-ae64-2e2788255306 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:06.890390 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-be31084d-1dc2-44b3-ae64-2e2788255306 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:06.905327 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-be31084d-1dc2-44b3-ae64-2e2788255306 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041" status: 200 len: 1363 microversion: 2.1 time: 0.640402 Jul 28 05:37:06.906288 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 493/717] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:37:06 2022] GET /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041 => generated 1363 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:37:06.910876 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-766127d5-c7bc-4cdc-80cf-bf78f1bded1e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:06.911483 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-766127d5-c7bc-4cdc-80cf-bf78f1bded1e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:06.929217 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-766127d5-c7bc-4cdc-80cf-bf78f1bded1e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:06.929701 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-766127d5-c7bc-4cdc-80cf-bf78f1bded1e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:06.930477 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-766127d5-c7bc-4cdc-80cf-bf78f1bded1e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:06.930918 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-766127d5-c7bc-4cdc-80cf-bf78f1bded1e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:07.183021 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-766127d5-c7bc-4cdc-80cf-bf78f1bded1e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:07.195358 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-766127d5-c7bc-4cdc-80cf-bf78f1bded1e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:07.196950 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-766127d5-c7bc-4cdc-80cf-bf78f1bded1e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:07.198353 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-766127d5-c7bc-4cdc-80cf-bf78f1bded1e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 200 len: 1725 microversion: 2.20 time: 0.291136 Jul 28 05:37:07.202911 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 494/718] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:37:06 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 1725 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:37:07.204651 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-c3d9b9b0-05b1-4563-a396-b5035b25e6e9 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:07.205444 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-c3d9b9b0-05b1-4563-a396-b5035b25e6e9 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: b9162e60-7996-4d4d-964f-6844383357b6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:07.211537 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c3d9b9b0-05b1-4563-a396-b5035b25e6e9 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:07.212181 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c3d9b9b0-05b1-4563-a396-b5035b25e6e9 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:07.213123 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c3d9b9b0-05b1-4563-a396-b5035b25e6e9 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:07.214335 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c3d9b9b0-05b1-4563-a396-b5035b25e6e9 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:07.290367 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-c3d9b9b0-05b1-4563-a396-b5035b25e6e9 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:07.301232 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-c3d9b9b0-05b1-4563-a396-b5035b25e6e9 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/b9162e60-7996-4d4d-964f-6844383357b6" status: 200 len: 1616 microversion: 2.1 time: 0.101138 Jul 28 05:37:07.302559 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 495/719] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:37:07 2022] GET /compute/v2.1/servers/b9162e60-7996-4d4d-964f-6844383357b6 => generated 1616 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:37:07.498560 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell0:SELECT=2 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:37:07.728780 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-6d4e056a-91c4-4130-96c7-cfe8f2ac4682 req-b0ac3a07-8a73-4dd2-ada4-be5c6a94e3dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9162e60-7996-4d4d-964f-6844383357b6", "name": "network-vif-deleted", "tag": "30d872c4-2287-4532-9e34-e113896ad3a6"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:37:07.739430 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-6d4e056a-91c4-4130-96c7-cfe8f2ac4682 req-b0ac3a07-8a73-4dd2-ada4-be5c6a94e3dd service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:07.742260 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-6d4e056a-91c4-4130-96c7-cfe8f2ac4682 req-b0ac3a07-8a73-4dd2-ada4-be5c6a94e3dd service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:07.752320 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-6d4e056a-91c4-4130-96c7-cfe8f2ac4682 req-b0ac3a07-8a73-4dd2-ada4-be5c6a94e3dd service nova] Creating event network-vif-deleted:30d872c4-2287-4532-9e34-e113896ad3a6 for instance b9162e60-7996-4d4d-964f-6844383357b6 on hv-cinder-79987 Jul 28 05:37:07.757410 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-6d4e056a-91c4-4130-96c7-cfe8f2ac4682 req-b0ac3a07-8a73-4dd2-ada4-be5c6a94e3dd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.453480 Jul 28 05:37:07.758285 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 496/720] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:37:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:37:07.764126 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-1bb5a9df-7c5e-4458-974a-90b73533de53 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:07.765037 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-1bb5a9df-7c5e-4458-974a-90b73533de53 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] [instance: 549e692f-7b6f-4ab0-987b-986a1934630e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:07.771560 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1bb5a9df-7c5e-4458-974a-90b73533de53 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:07.772015 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1bb5a9df-7c5e-4458-974a-90b73533de53 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:07.772789 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1bb5a9df-7c5e-4458-974a-90b73533de53 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:07.773283 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1bb5a9df-7c5e-4458-974a-90b73533de53 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:07.994043 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-1bb5a9df-7c5e-4458-974a-90b73533de53 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d859e797d874c948325f2ce0978edb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5989fabc615545eeb4ef987dea566175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:08.008501 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-1bb5a9df-7c5e-4458-974a-90b73533de53 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] 10.222.0.33 "GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e" status: 200 len: 1358 microversion: 2.1 time: 0.248393 Jul 28 05:37:08.012072 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 497/721] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:37:07 2022] GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e => generated 1358 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:37:08.201402 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-f44b2491-130a-4f13-9f92-967c2728bda0 req-ecb3f44e-0e18-4ff6-813b-22c611b7800c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4c59c70-b18e-4e7d-ad59-50b0e2e66041", "tag": "6358d70d-ca49-4c50-af18-16013f79bc5a"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:37:08.212355 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-f44b2491-130a-4f13-9f92-967c2728bda0 req-ecb3f44e-0e18-4ff6-813b-22c611b7800c service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:08.212863 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-f44b2491-130a-4f13-9f92-967c2728bda0 req-ecb3f44e-0e18-4ff6-813b-22c611b7800c service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:08.229887 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-f44b2491-130a-4f13-9f92-967c2728bda0 req-ecb3f44e-0e18-4ff6-813b-22c611b7800c service nova] Creating event network-changed:6358d70d-ca49-4c50-af18-16013f79bc5a for instance b4c59c70-b18e-4e7d-ad59-50b0e2e66041 on hv-cinder-79987 Jul 28 05:37:08.233619 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-f44b2491-130a-4f13-9f92-967c2728bda0 req-ecb3f44e-0e18-4ff6-813b-22c611b7800c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.218626 Jul 28 05:37:08.234751 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 498/722] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:37:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:37:08.242021 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-719ba6b5-8f7b-4350-9e17-2c8471c328b5 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:08.243066 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-719ba6b5-8f7b-4350-9e17-2c8471c328b5 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: b4c59c70-b18e-4e7d-ad59-50b0e2e66041] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:08.252263 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-719ba6b5-8f7b-4350-9e17-2c8471c328b5 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:08.253857 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-719ba6b5-8f7b-4350-9e17-2c8471c328b5 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:08.254821 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-719ba6b5-8f7b-4350-9e17-2c8471c328b5 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:08.255557 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-719ba6b5-8f7b-4350-9e17-2c8471c328b5 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:08.485312 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell0:SELECT=24 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:37:08.507098 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-719ba6b5-8f7b-4350-9e17-2c8471c328b5 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:08.523151 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-719ba6b5-8f7b-4350-9e17-2c8471c328b5 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041" status: 200 len: 1363 microversion: 2.1 time: 0.286947 Jul 28 05:37:08.548148 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 499/723] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:37:08 2022] GET /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041 => generated 1363 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:37:08.557616 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-23efe6aa-bc5a-4f81-ba6d-c98d18684d82 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:08.558387 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-23efe6aa-bc5a-4f81-ba6d-c98d18684d82 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:08.565848 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-23efe6aa-bc5a-4f81-ba6d-c98d18684d82 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:08.566302 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-23efe6aa-bc5a-4f81-ba6d-c98d18684d82 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:08.567113 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-23efe6aa-bc5a-4f81-ba6d-c98d18684d82 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:08.567558 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-23efe6aa-bc5a-4f81-ba6d-c98d18684d82 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:08.744292 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-23efe6aa-bc5a-4f81-ba6d-c98d18684d82 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:08.754517 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-23efe6aa-bc5a-4f81-ba6d-c98d18684d82 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:08.756172 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-23efe6aa-bc5a-4f81-ba6d-c98d18684d82 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:08.757356 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-23efe6aa-bc5a-4f81-ba6d-c98d18684d82 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 200 len: 1725 microversion: 2.20 time: 0.208164 Jul 28 05:37:08.758198 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 500/724] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:37:08 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 1725 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:37:08.762589 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-0c7fcd36-a384-458f-8bec-3b8a216083cb tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:08.763389 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-0c7fcd36-a384-458f-8bec-3b8a216083cb tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: b9162e60-7996-4d4d-964f-6844383357b6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:08.769490 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-0c7fcd36-a384-458f-8bec-3b8a216083cb tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:08.770200 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-0c7fcd36-a384-458f-8bec-3b8a216083cb tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:08.770970 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-0c7fcd36-a384-458f-8bec-3b8a216083cb tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:08.771413 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-0c7fcd36-a384-458f-8bec-3b8a216083cb tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:08.789087 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.wsgi [None req-0c7fcd36-a384-458f-8bec-3b8a216083cb tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] HTTP exception thrown: Instance b9162e60-7996-4d4d-964f-6844383357b6 could not be found. Jul 28 05:37:08.791262 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-0c7fcd36-a384-458f-8bec-3b8a216083cb tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Request method failure captured: Jul 28 05:37:08.791262 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: request: GET /compute/v2.1/servers/b9162e60-7996-4d4d-964f-6844383357b6 HTTP/1.1 Jul 28 05:37:08.791262 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept: application/json Jul 28 05:37:08.791262 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept-Encoding: identity Jul 28 05:37:08.791262 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Connection: close Jul 28 05:37:08.791262 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Length: 0 Jul 28 05:37:08.791262 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Type: application/json Jul 28 05:37:08.791262 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Host: 10.222.0.33 Jul 28 05:37:08.791262 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Openstack-System-Scope: None Jul 28 05:37:08.791262 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: User-Agent: python-urllib3/1.26.10 Jul 28 05:37:08.791262 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Auth-Token: gAAAAABi4h9D_G9i011T28yIc-ZNvejV_UpI0QoKlXE0FGZ91QFBkrT7qoFtXVHh-pu6aHMGmM56LTiBsS724USe_vuB1sVPXPQos6zopSWxHNIiTv0vnR9zJg55cl6dG7-t6mrt4b6a18Xfa5nEVVolwB-FkmudbFUJziZU1gufozNL3J-fAhg Jul 28 05:37:08.791262 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Id: None Jul 28 05:37:08.791262 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Name: None Jul 28 05:37:08.791262 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Identity-Status: Confirmed Jul 28 05:37:08.791262 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Is-Admin-Project: True Jul 28 05:37:08.791262 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Id: default Jul 28 05:37:08.791262 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Name: Default Jul 28 05:37:08.791262 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Id: ba0b7f7639504a25a73c94335d62b98f Jul 28 05:37:08.791262 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Name: tempest-AttachVolumeNegativeTest-1557602675 Jul 28 05:37:08.791262 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Role: member,reader Jul 28 05:37:08.791262 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Roles: member,reader Jul 28 05:37:08.792604 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ba0b7f7639504a25a73c94335d62b98f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ba0b7f7639504a25a73c94335d62b98f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ba0b7f7639504a25a73c94335d62b98f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ba0b7f7639504a25a73c94335d62b98f"}]}] Jul 28 05:37:08.792604 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant: tempest-AttachVolumeNegativeTest-1557602675 Jul 28 05:37:08.792604 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Id: ba0b7f7639504a25a73c94335d62b98f Jul 28 05:37:08.792604 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1557602675 Jul 28 05:37:08.792604 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User: tempest-AttachVolumeNegativeTest-1557602675-project Jul 28 05:37:08.792604 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Id: default Jul 28 05:37:08.792604 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Name: Default Jul 28 05:37:08.792604 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Id: 0002ebbc629b4dafb109dc94450fe1d8 Jul 28 05:37:08.792604 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Name: tempest-AttachVolumeNegativeTest-1557602675-project Jul 28 05:37:08.792604 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: method: > Jul 28 05:37:08.792604 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: exception: Instance b9162e60-7996-4d4d-964f-6844383357b6 could not be found. Jul 28 05:37:08.792604 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: action_args: {'id': 'b9162e60-7996-4d4d-964f-6844383357b6'} Jul 28 05:37:08.797688 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 05:37:08.797688 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:37:08.797688 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 05:37:08.797688 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 05:37:08.797688 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 05:37:08.797688 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 05:37:08.797688 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 05:37:08.797688 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 05:37:08.797688 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 05:37:08.797688 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 05:37:08.797688 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9162e60-7996-4d4d-964f-6844383357b6 could not be found. Jul 28 05:37:08.797688 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:37:08.797688 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:37:08.797688 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:37:08.797688 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:37:08.797688 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:37:08.797688 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:37:08.797688 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 05:37:08.797688 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 05:37:08.797688 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 05:37:08.799033 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:37:08.799033 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 05:37:08.799033 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 05:37:08.799033 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 05:37:08.799033 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 05:37:08.799033 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 05:37:08.799033 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 05:37:08.799033 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9162e60-7996-4d4d-964f-6844383357b6 could not be found. Jul 28 05:37:08.799033 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:37:08.799033 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:37:08.799033 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:37:08.799033 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:37:08.799033 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:37:08.799033 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:37:08.799033 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 05:37:08.799033 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 05:37:08.799033 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9162e60-7996-4d4d-964f-6844383357b6 could not be found. Jul 28 05:37:08.799033 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:37:08.801181 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-0c7fcd36-a384-458f-8bec-3b8a216083cb tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Returning 404 to user: Instance b9162e60-7996-4d4d-964f-6844383357b6 could not be found. {{(pid=124482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 05:37:08.801181 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-0c7fcd36-a384-458f-8bec-3b8a216083cb tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/b9162e60-7996-4d4d-964f-6844383357b6" status: 404 len: 111 microversion: 2.1 time: 0.033585 Jul 28 05:37:08.801181 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 501/725] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:37:08 2022] GET /compute/v2.1/servers/b9162e60-7996-4d4d-964f-6844383357b6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 05:37:08.802429 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-e981aa49-344e-408c-80fd-3165d5f60e8f tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '.version_select at 0x7f25e0271a60>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:08.882682 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-e981aa49-344e-408c-80fd-3165d5f60e8f tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1694396167" status: 202 len: 0 microversion: 2.1 time: 0.084179 Jul 28 05:37:08.883758 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 502/726] 10.222.0.33 () {58 vars in 1221 bytes} [Thu Jul 28 05:37:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1694396167 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 05:37:09.031789 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-953dc3fb-8d78-4980-9900-f113530bd5f6 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:09.032413 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-953dc3fb-8d78-4980-9900-f113530bd5f6 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] [instance: 549e692f-7b6f-4ab0-987b-986a1934630e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:09.045358 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-953dc3fb-8d78-4980-9900-f113530bd5f6 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:09.045891 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-953dc3fb-8d78-4980-9900-f113530bd5f6 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:09.046823 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-953dc3fb-8d78-4980-9900-f113530bd5f6 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:09.047595 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-953dc3fb-8d78-4980-9900-f113530bd5f6 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:09.197992 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-953dc3fb-8d78-4980-9900-f113530bd5f6 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d859e797d874c948325f2ce0978edb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5989fabc615545eeb4ef987dea566175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:09.206667 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-953dc3fb-8d78-4980-9900-f113530bd5f6 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] 10.222.0.33 "GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e" status: 200 len: 1358 microversion: 2.1 time: 0.179761 Jul 28 05:37:09.207249 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 503/727] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:37:09 2022] GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:37:09.211842 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-f95f222b-96bd-46d6-86e4-79cda95048b7 req-4e8e54dd-ba7c-4838-8f87-feb88035b692 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "549e692f-7b6f-4ab0-987b-986a1934630e", "name": "network-vif-plugged", "status": "completed", "tag": "b49100c3-29f8-45db-910f-805da59e6250"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:37:09.222263 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-f95f222b-96bd-46d6-86e4-79cda95048b7 req-4e8e54dd-ba7c-4838-8f87-feb88035b692 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:09.222706 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-f95f222b-96bd-46d6-86e4-79cda95048b7 req-4e8e54dd-ba7c-4838-8f87-feb88035b692 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:09.234989 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-f95f222b-96bd-46d6-86e4-79cda95048b7 req-4e8e54dd-ba7c-4838-8f87-feb88035b692 service nova] Creating event network-vif-plugged:b49100c3-29f8-45db-910f-805da59e6250 for instance 549e692f-7b6f-4ab0-987b-986a1934630e on hv-cinder-79987 Jul 28 05:37:09.241568 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-f95f222b-96bd-46d6-86e4-79cda95048b7 req-4e8e54dd-ba7c-4838-8f87-feb88035b692 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033092 Jul 28 05:37:09.242189 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 504/728] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:37:09.545738 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-7c6e8e3c-b213-490c-a870-789a702aeda9 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:09.547190 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-7c6e8e3c-b213-490c-a870-789a702aeda9 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: b4c59c70-b18e-4e7d-ad59-50b0e2e66041] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:09.553657 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7c6e8e3c-b213-490c-a870-789a702aeda9 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:09.554115 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7c6e8e3c-b213-490c-a870-789a702aeda9 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:09.554911 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7c6e8e3c-b213-490c-a870-789a702aeda9 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:09.555387 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7c6e8e3c-b213-490c-a870-789a702aeda9 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:09.758305 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-7c6e8e3c-b213-490c-a870-789a702aeda9 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:09.769516 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-7c6e8e3c-b213-490c-a870-789a702aeda9 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041" status: 200 len: 1363 microversion: 2.1 time: 0.228639 Jul 28 05:37:09.771746 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 505/729] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:37:09 2022] GET /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041 => generated 1363 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:37:09.787987 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-c945f63a-9e5e-48d4-88c5-3b816820adc1 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:09.789045 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-c945f63a-9e5e-48d4-88c5-3b816820adc1 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:09.797312 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c945f63a-9e5e-48d4-88c5-3b816820adc1 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:09.797815 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c945f63a-9e5e-48d4-88c5-3b816820adc1 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:09.798589 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c945f63a-9e5e-48d4-88c5-3b816820adc1 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:09.799024 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c945f63a-9e5e-48d4-88c5-3b816820adc1 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:10.026222 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-c945f63a-9e5e-48d4-88c5-3b816820adc1 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:10.034840 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-c945f63a-9e5e-48d4-88c5-3b816820adc1 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:10.036278 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-c945f63a-9e5e-48d4-88c5-3b816820adc1 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:10.037436 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-c945f63a-9e5e-48d4-88c5-3b816820adc1 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 200 len: 1725 microversion: 2.20 time: 0.256720 Jul 28 05:37:10.041888 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 506/730] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:37:09 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 1725 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 05:37:10.042655 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-2ec227fa-fe02-4cf1-9b4b-e062275f499d tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Action: 'create', calling method: .version_select at 0x7f25e02710d0>, body: {"keypair": {"name": "tempest-keypair-1611344322", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMNMIDkNRIjQ1dXzcPzSYsEEUeeVUo5YRsItTGpWng1sghLFp2QkH6qPlThq5uy6AoMuWk9FT15BPjWmZf0fBk/bCh8Ati/JB/QBervfV5m3OsZq5aBDYUXetY/jtg0+6g=="}} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:37:10.059006 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.quota [None req-2ec227fa-fe02-4cf1-9b4b-e062275f499d tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Getting quotas for project ba0b7f7639504a25a73c94335d62b98f. Resources: {'key_pairs'} {{(pid=124482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 05:37:10.063940 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.quota [None req-2ec227fa-fe02-4cf1-9b4b-e062275f499d tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Getting quotas for user 0002ebbc629b4dafb109dc94450fe1d8 and project ba0b7f7639504a25a73c94335d62b98f. Resources: {'key_pairs'} {{(pid=124482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 05:37:10.163165 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-2ec227fa-fe02-4cf1-9b4b-e062275f499d tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.124015 Jul 28 05:37:10.163962 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 507/731] 10.222.0.33 () {60 vars in 1159 bytes} [Thu Jul 28 05:37:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:37:10.227932 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-1dc8c74f-3ba5-43eb-bb77-0c65c940af7b tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:10.228833 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-1dc8c74f-3ba5-43eb-bb77-0c65c940af7b tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] [instance: 549e692f-7b6f-4ab0-987b-986a1934630e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:10.236153 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1dc8c74f-3ba5-43eb-bb77-0c65c940af7b tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:10.236824 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1dc8c74f-3ba5-43eb-bb77-0c65c940af7b tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:10.243140 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1dc8c74f-3ba5-43eb-bb77-0c65c940af7b tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:10.245128 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1dc8c74f-3ba5-43eb-bb77-0c65c940af7b tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:10.402523 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-1dc8c74f-3ba5-43eb-bb77-0c65c940af7b tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d859e797d874c948325f2ce0978edb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5989fabc615545eeb4ef987dea566175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:10.411141 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-1dc8c74f-3ba5-43eb-bb77-0c65c940af7b tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] 10.222.0.33 "GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e" status: 200 len: 1358 microversion: 2.1 time: 0.187148 Jul 28 05:37:10.414796 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 508/732] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:37:10 2022] GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:37:10.791322 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-f095252b-9357-437e-8394-1871deb71ded tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:10.792015 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-f095252b-9357-437e-8394-1871deb71ded tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: b4c59c70-b18e-4e7d-ad59-50b0e2e66041] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:10.798658 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f095252b-9357-437e-8394-1871deb71ded tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:10.799110 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f095252b-9357-437e-8394-1871deb71ded tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:10.799882 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f095252b-9357-437e-8394-1871deb71ded tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:10.800320 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f095252b-9357-437e-8394-1871deb71ded tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:10.958870 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-f095252b-9357-437e-8394-1871deb71ded tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:10.967123 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-f095252b-9357-437e-8394-1871deb71ded tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041" status: 200 len: 1363 microversion: 2.1 time: 0.179070 Jul 28 05:37:10.980090 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 509/733] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:37:10 2022] GET /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041 => generated 1363 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:37:11.060168 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-b4d14895-d0a1-45fb-a4bd-d91ff721f08f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:11.069050 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-b4d14895-d0a1-45fb-a4bd-d91ff721f08f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:11.071250 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b4d14895-d0a1-45fb-a4bd-d91ff721f08f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:11.071717 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b4d14895-d0a1-45fb-a4bd-d91ff721f08f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:11.072494 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b4d14895-d0a1-45fb-a4bd-d91ff721f08f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:11.072927 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b4d14895-d0a1-45fb-a4bd-d91ff721f08f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:11.256459 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-b4d14895-d0a1-45fb-a4bd-d91ff721f08f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:11.268541 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-b4d14895-d0a1-45fb-a4bd-d91ff721f08f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:11.270335 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-b4d14895-d0a1-45fb-a4bd-d91ff721f08f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:11.275157 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-b4d14895-d0a1-45fb-a4bd-d91ff721f08f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 200 len: 1725 microversion: 2.20 time: 0.215451 Jul 28 05:37:11.275157 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 510/734] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:37:11 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 1725 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 05:37:11.433395 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-2a538198-9f94-4c9b-86a5-7d8a68d42cbf tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:11.434153 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-2a538198-9f94-4c9b-86a5-7d8a68d42cbf tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] [instance: 549e692f-7b6f-4ab0-987b-986a1934630e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:11.442609 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2a538198-9f94-4c9b-86a5-7d8a68d42cbf tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:11.443111 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2a538198-9f94-4c9b-86a5-7d8a68d42cbf tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:11.444034 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2a538198-9f94-4c9b-86a5-7d8a68d42cbf tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:11.444501 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2a538198-9f94-4c9b-86a5-7d8a68d42cbf tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:11.682042 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-2a538198-9f94-4c9b-86a5-7d8a68d42cbf tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d859e797d874c948325f2ce0978edb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5989fabc615545eeb4ef987dea566175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:11.685422 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell1:SELECT=100 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:37:11.691858 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-2a538198-9f94-4c9b-86a5-7d8a68d42cbf tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] 10.222.0.33 "GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e" status: 200 len: 1358 microversion: 2.1 time: 0.262258 Jul 28 05:37:11.692641 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 511/735] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:37:11 2022] GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e => generated 1358 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:37:11.988258 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-3fda4fd9-a1f4-435e-80ea-ebdfa8d5d6cf tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:11.988880 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-3fda4fd9-a1f4-435e-80ea-ebdfa8d5d6cf tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: b4c59c70-b18e-4e7d-ad59-50b0e2e66041] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:11.995041 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3fda4fd9-a1f4-435e-80ea-ebdfa8d5d6cf tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:11.995488 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3fda4fd9-a1f4-435e-80ea-ebdfa8d5d6cf tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:12.001637 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3fda4fd9-a1f4-435e-80ea-ebdfa8d5d6cf tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:12.001637 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3fda4fd9-a1f4-435e-80ea-ebdfa8d5d6cf tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:12.154649 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-3fda4fd9-a1f4-435e-80ea-ebdfa8d5d6cf tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:12.162031 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-3fda4fd9-a1f4-435e-80ea-ebdfa8d5d6cf tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041" status: 200 len: 1363 microversion: 2.1 time: 0.178385 Jul 28 05:37:12.162594 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 512/736] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:37:11 2022] GET /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041 => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:37:12.298755 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-01bba091-a56d-47b3-8a7e-d3c4017ea88f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:12.299376 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-01bba091-a56d-47b3-8a7e-d3c4017ea88f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:12.305314 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-01bba091-a56d-47b3-8a7e-d3c4017ea88f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:12.305806 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-01bba091-a56d-47b3-8a7e-d3c4017ea88f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:12.306768 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-01bba091-a56d-47b3-8a7e-d3c4017ea88f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:12.307206 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-01bba091-a56d-47b3-8a7e-d3c4017ea88f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:12.467722 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-01bba091-a56d-47b3-8a7e-d3c4017ea88f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:12.476459 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-01bba091-a56d-47b3-8a7e-d3c4017ea88f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:12.478751 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-01bba091-a56d-47b3-8a7e-d3c4017ea88f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:12.480193 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-01bba091-a56d-47b3-8a7e-d3c4017ea88f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 200 len: 1725 microversion: 2.20 time: 0.189406 Jul 28 05:37:12.480925 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 513/737] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:37:12 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 1725 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 05:37:12.702828 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-7ea5223d-0609-4ba2-86a1-76fb058815ca tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1375606048", "imageRef": "4f0ce061-6677-4c2a-9ee1-54a100f21462", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f094ee85-e5f7-4f76-b25b-19d66faa4449"}], "security_groups": [{"name": "tempest-securitygroup--1223401834"}], "key_name": "tempest-keypair-1611344322", "user_data": "}} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:37:12.812855 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.network.neutron [None req-7ea5223d-0609-4ba2-86a1-76fb058815ca tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] validate_networks() for [('f094ee85-e5f7-4f76-b25b-19d66faa4449', None, None, None, None, None)] {{(pid=124482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 05:37:13.199867 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-7ea5223d-0609-4ba2-86a1-76fb058815ca tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Flavor limits 0:0:0 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 05:37:13.201018 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-7ea5223d-0609-4ba2-86a1-76fb058815ca tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Image limits 0:0:0 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 05:37:13.201395 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-7ea5223d-0609-4ba2-86a1-76fb058815ca tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Flavor pref 0:0:0 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 05:37:13.201914 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-7ea5223d-0609-4ba2-86a1-76fb058815ca tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Image pref 0:0:0 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 05:37:13.202321 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-7ea5223d-0609-4ba2-86a1-76fb058815ca tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 05:37:13.204243 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:37:13.211835 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7ea5223d-0609-4ba2-86a1-76fb058815ca tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:13.214488 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7ea5223d-0609-4ba2-86a1-76fb058815ca tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:13.214488 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7ea5223d-0609-4ba2-86a1-76fb058815ca tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:13.214488 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7ea5223d-0609-4ba2-86a1-76fb058815ca tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:13.230868 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.quota [None req-7ea5223d-0609-4ba2-86a1-76fb058815ca tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Getting quotas for project ba0b7f7639504a25a73c94335d62b98f. Resources: {'ram', 'instances', 'cores'} {{(pid=124482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 05:37:13.235184 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.quota [None req-7ea5223d-0609-4ba2-86a1-76fb058815ca tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Getting quotas for user 0002ebbc629b4dafb109dc94450fe1d8 and project ba0b7f7639504a25a73c94335d62b98f. Resources: {'ram', 'instances', 'cores'} {{(pid=124482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 05:37:13.247860 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-7ea5223d-0609-4ba2-86a1-76fb058815ca tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Going to run 1 instances... {{(pid=124482) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 05:37:13.250451 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-7ea5223d-0609-4ba2-86a1-76fb058815ca tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: 9557131e-b3ea-4672-bdae-75a0c5a120e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f0ce061-6677-4c2a-9ee1-54a100f21462',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 05:37:13.418488 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-7ea5223d-0609-4ba2-86a1-76fb058815ca tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.720720 Jul 28 05:37:13.419362 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 514/738] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Jul 28 05:37:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 05:37:13.419362 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-28bb1183-2c74-41fb-9844-30e9eb8c4970 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:13.419362 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-28bb1183-2c74-41fb-9844-30e9eb8c4970 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] [instance: 549e692f-7b6f-4ab0-987b-986a1934630e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:13.431219 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-28bb1183-2c74-41fb-9844-30e9eb8c4970 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:13.431670 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-28bb1183-2c74-41fb-9844-30e9eb8c4970 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:13.434131 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-28bb1183-2c74-41fb-9844-30e9eb8c4970 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:13.434131 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-28bb1183-2c74-41fb-9844-30e9eb8c4970 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:13.625171 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-28bb1183-2c74-41fb-9844-30e9eb8c4970 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d859e797d874c948325f2ce0978edb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5989fabc615545eeb4ef987dea566175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:13.632325 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-28bb1183-2c74-41fb-9844-30e9eb8c4970 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] 10.222.0.33 "GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e" status: 200 len: 1549 microversion: 2.1 time: 0.211926 Jul 28 05:37:13.645670 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 515/739] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:37:13 2022] GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e => generated 1549 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:37:13.645670 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-f9783838-ddcd-47d5-94d0-f73ea2d01ff6 req-36d259e8-1960-4aec-8209-e772002d02ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4c59c70-b18e-4e7d-ad59-50b0e2e66041", "name": "network-vif-plugged", "status": "completed", "tag": "6358d70d-ca49-4c50-af18-16013f79bc5a"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:37:13.649122 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-f9783838-ddcd-47d5-94d0-f73ea2d01ff6 req-36d259e8-1960-4aec-8209-e772002d02ca service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:13.649772 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-f9783838-ddcd-47d5-94d0-f73ea2d01ff6 req-36d259e8-1960-4aec-8209-e772002d02ca service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:13.662634 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-f9783838-ddcd-47d5-94d0-f73ea2d01ff6 req-36d259e8-1960-4aec-8209-e772002d02ca service nova] Creating event network-vif-plugged:6358d70d-ca49-4c50-af18-16013f79bc5a for instance b4c59c70-b18e-4e7d-ad59-50b0e2e66041 on hv-cinder-79987 Jul 28 05:37:13.667467 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-f9783838-ddcd-47d5-94d0-f73ea2d01ff6 req-36d259e8-1960-4aec-8209-e772002d02ca service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033497 Jul 28 05:37:13.668041 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 516/740] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:37:13.673825 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-da1b2b69-3080-406f-99f7-5f6eb62fbd05 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:13.674562 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-da1b2b69-3080-406f-99f7-5f6eb62fbd05 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: b4c59c70-b18e-4e7d-ad59-50b0e2e66041] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:13.680611 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-da1b2b69-3080-406f-99f7-5f6eb62fbd05 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:13.681054 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-da1b2b69-3080-406f-99f7-5f6eb62fbd05 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:13.681846 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-da1b2b69-3080-406f-99f7-5f6eb62fbd05 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:13.682327 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-da1b2b69-3080-406f-99f7-5f6eb62fbd05 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:13.835096 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-da1b2b69-3080-406f-99f7-5f6eb62fbd05 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:13.842790 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-da1b2b69-3080-406f-99f7-5f6eb62fbd05 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041" status: 200 len: 1363 microversion: 2.1 time: 0.173644 Jul 28 05:37:13.843553 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 517/741] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:37:13 2022] GET /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:37:13.848580 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-de8705c6-4c06-49d5-bbf9-301f68200229 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:13.849187 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-de8705c6-4c06-49d5-bbf9-301f68200229 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: 9557131e-b3ea-4672-bdae-75a0c5a120e3] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:13.912635 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-de8705c6-4c06-49d5-bbf9-301f68200229 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:13.920116 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-de8705c6-4c06-49d5-bbf9-301f68200229 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3" status: 200 len: 1242 microversion: 2.1 time: 0.075739 Jul 28 05:37:13.920763 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 518/742] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:37:13 2022] GET /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3 => generated 1242 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:37:13.925395 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-078368fa-4707-4173-98e7-5610663b7f98 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:13.926142 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-078368fa-4707-4173-98e7-5610663b7f98 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:13.932190 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-078368fa-4707-4173-98e7-5610663b7f98 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:13.932626 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-078368fa-4707-4173-98e7-5610663b7f98 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:13.933383 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-078368fa-4707-4173-98e7-5610663b7f98 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:13.933836 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-078368fa-4707-4173-98e7-5610663b7f98 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:14.126003 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-078368fa-4707-4173-98e7-5610663b7f98 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:14.134381 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-078368fa-4707-4173-98e7-5610663b7f98 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:14.135873 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-078368fa-4707-4173-98e7-5610663b7f98 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:14.137059 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-078368fa-4707-4173-98e7-5610663b7f98 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 200 len: 1725 microversion: 2.20 time: 0.215460 Jul 28 05:37:14.138268 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 519/743] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:37:13 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 1725 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:37:14.142940 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-fa0ee0d3-279c-42a7-9f6b-efa5e9078ce9 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:14.143708 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-fa0ee0d3-279c-42a7-9f6b-efa5e9078ce9 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] [instance: 549e692f-7b6f-4ab0-987b-986a1934630e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:14.150144 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-fa0ee0d3-279c-42a7-9f6b-efa5e9078ce9 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:14.150794 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-fa0ee0d3-279c-42a7-9f6b-efa5e9078ce9 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:14.151554 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-fa0ee0d3-279c-42a7-9f6b-efa5e9078ce9 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:14.151985 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-fa0ee0d3-279c-42a7-9f6b-efa5e9078ce9 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:14.284613 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-fa0ee0d3-279c-42a7-9f6b-efa5e9078ce9 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d859e797d874c948325f2ce0978edb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5989fabc615545eeb4ef987dea566175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:14.292600 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-fa0ee0d3-279c-42a7-9f6b-efa5e9078ce9 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] 10.222.0.33 "GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e" status: 200 len: 1549 microversion: 2.1 time: 0.153372 Jul 28 05:37:14.293181 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 520/744] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:37:14 2022] GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e => generated 1549 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:37:14.314480 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-f226463b-35ac-4b7a-8158-93c8c4f9740c tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:14.319450 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-f226463b-35ac-4b7a-8158-93c8c4f9740c tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7d859e797d874c948325f2ce0978edb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5989fabc615545eeb4ef987dea566175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:14.320220 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-f226463b-35ac-4b7a-8158-93c8c4f9740c tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Searching by: {'deleted': False, 'project_id': '5989fabc615545eeb4ef987dea566175'} {{(pid=124482) get_all /opt/stack/nova/nova/compute/api.py:2965}} Jul 28 05:37:14.327491 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f226463b-35ac-4b7a-8158-93c8c4f9740c tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:14.327933 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f226463b-35ac-4b7a-8158-93c8c4f9740c tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:14.328733 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f226463b-35ac-4b7a-8158-93c8c4f9740c tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:14.329171 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f226463b-35ac-4b7a-8158-93c8c4f9740c tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:14.420638 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.multi_cell_list [None req-f226463b-35ac-4b7a-8158-93c8c4f9740c tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124482) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 05:37:14.522581 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-f226463b-35ac-4b7a-8158-93c8c4f9740c tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.213325 Jul 28 05:37:14.523076 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 521/745] 10.222.0.33 () {58 vars in 1125 bytes} [Thu Jul 28 05:37:14 2022] GET /compute/v2.1/servers => generated 343 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 05:37:14.534416 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-d0286bd7-4d1c-43c7-8886-d4b4ed701047 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:14.535029 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-d0286bd7-4d1c-43c7-8886-d4b4ed701047 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] [instance: 549e692f-7b6f-4ab0-987b-986a1934630e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:14.540901 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d0286bd7-4d1c-43c7-8886-d4b4ed701047 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:14.541351 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d0286bd7-4d1c-43c7-8886-d4b4ed701047 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:14.542175 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d0286bd7-4d1c-43c7-8886-d4b4ed701047 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:14.542615 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d0286bd7-4d1c-43c7-8886-d4b4ed701047 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:14.685698 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-d0286bd7-4d1c-43c7-8886-d4b4ed701047 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d859e797d874c948325f2ce0978edb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5989fabc615545eeb4ef987dea566175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:14.693897 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-d0286bd7-4d1c-43c7-8886-d4b4ed701047 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] 10.222.0.33 "GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e" status: 200 len: 1549 microversion: 2.1 time: 0.163164 Jul 28 05:37:14.694518 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 522/746] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:37:14 2022] GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e => generated 1549 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:37:14.863545 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-88243f5e-26e2-4643-b92d-d6edcbfebf5d tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:14.866777 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-88243f5e-26e2-4643-b92d-d6edcbfebf5d tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: b4c59c70-b18e-4e7d-ad59-50b0e2e66041] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:14.870234 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-88243f5e-26e2-4643-b92d-d6edcbfebf5d tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:14.870745 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-88243f5e-26e2-4643-b92d-d6edcbfebf5d tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:14.871579 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-88243f5e-26e2-4643-b92d-d6edcbfebf5d tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:14.872676 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-88243f5e-26e2-4643-b92d-d6edcbfebf5d tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:15.012072 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-88243f5e-26e2-4643-b92d-d6edcbfebf5d tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:15.020460 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-88243f5e-26e2-4643-b92d-d6edcbfebf5d tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041" status: 200 len: 1363 microversion: 2.1 time: 0.160856 Jul 28 05:37:15.021042 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 523/747] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:37:14 2022] GET /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:37:15.036513 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-58aaf0e6-efce-451f-9393-fd0f6f48204c tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:15.037070 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-58aaf0e6-efce-451f-9393-fd0f6f48204c tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: 9557131e-b3ea-4672-bdae-75a0c5a120e3] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:15.043139 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-58aaf0e6-efce-451f-9393-fd0f6f48204c tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:15.043585 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-58aaf0e6-efce-451f-9393-fd0f6f48204c tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:15.044443 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-58aaf0e6-efce-451f-9393-fd0f6f48204c tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:15.044875 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-58aaf0e6-efce-451f-9393-fd0f6f48204c tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:15.108065 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-58aaf0e6-efce-451f-9393-fd0f6f48204c tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:15.115536 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-58aaf0e6-efce-451f-9393-fd0f6f48204c tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3" status: 200 len: 1294 microversion: 2.1 time: 0.088825 Jul 28 05:37:15.117463 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 524/748] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:37:15 2022] GET /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3 => generated 1294 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:37:15.162017 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-369e7df2-b0de-4d21-9328-0a8d49bc4d6d tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:15.162741 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-369e7df2-b0de-4d21-9328-0a8d49bc4d6d tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:15.176818 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-369e7df2-b0de-4d21-9328-0a8d49bc4d6d tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:15.176818 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-369e7df2-b0de-4d21-9328-0a8d49bc4d6d tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:15.176818 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-369e7df2-b0de-4d21-9328-0a8d49bc4d6d tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:15.176818 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-369e7df2-b0de-4d21-9328-0a8d49bc4d6d tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:15.304393 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-369e7df2-b0de-4d21-9328-0a8d49bc4d6d tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:15.313572 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-369e7df2-b0de-4d21-9328-0a8d49bc4d6d tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:15.315131 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-369e7df2-b0de-4d21-9328-0a8d49bc4d6d tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:15.316298 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-369e7df2-b0de-4d21-9328-0a8d49bc4d6d tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 200 len: 1725 microversion: 2.20 time: 0.158144 Jul 28 05:37:15.316850 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 525/749] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:37:15 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 05:37:16.040167 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-99edefcb-9884-4ffc-acca-e54d094b5d5a tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:16.040771 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-99edefcb-9884-4ffc-acca-e54d094b5d5a tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: b4c59c70-b18e-4e7d-ad59-50b0e2e66041] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:16.047257 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-99edefcb-9884-4ffc-acca-e54d094b5d5a tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:16.047698 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-99edefcb-9884-4ffc-acca-e54d094b5d5a tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:16.048451 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-99edefcb-9884-4ffc-acca-e54d094b5d5a tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:16.048877 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-99edefcb-9884-4ffc-acca-e54d094b5d5a tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:16.251020 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-99edefcb-9884-4ffc-acca-e54d094b5d5a tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:16.265964 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-99edefcb-9884-4ffc-acca-e54d094b5d5a tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041" status: 200 len: 1548 microversion: 2.1 time: 0.228078 Jul 28 05:37:16.267091 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 526/750] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:37:16 2022] GET /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041 => generated 1548 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:37:16.273834 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-85a06086-5628-4473-9d45-b8a2d2f860aa tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:16.274606 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-85a06086-5628-4473-9d45-b8a2d2f860aa tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: 9557131e-b3ea-4672-bdae-75a0c5a120e3] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:16.284308 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-85a06086-5628-4473-9d45-b8a2d2f860aa tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:16.284776 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-85a06086-5628-4473-9d45-b8a2d2f860aa tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:16.285717 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-85a06086-5628-4473-9d45-b8a2d2f860aa tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:16.286365 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-85a06086-5628-4473-9d45-b8a2d2f860aa tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:16.363019 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-85a06086-5628-4473-9d45-b8a2d2f860aa tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:16.370753 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-85a06086-5628-4473-9d45-b8a2d2f860aa tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3" status: 200 len: 1312 microversion: 2.1 time: 0.101714 Jul 28 05:37:16.371330 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 527/751] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:37:16 2022] GET /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3 => generated 1312 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:37:16.376327 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-e154851b-6a5e-45a8-80dc-00647e9a95ed tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:16.376824 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-e154851b-6a5e-45a8-80dc-00647e9a95ed tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: b4c59c70-b18e-4e7d-ad59-50b0e2e66041] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:16.382690 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e154851b-6a5e-45a8-80dc-00647e9a95ed tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:16.383134 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e154851b-6a5e-45a8-80dc-00647e9a95ed tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:16.384099 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e154851b-6a5e-45a8-80dc-00647e9a95ed tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:16.384592 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e154851b-6a5e-45a8-80dc-00647e9a95ed tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:16.474199 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-e154851b-6a5e-45a8-80dc-00647e9a95ed tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101509 Jul 28 05:37:16.475134 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 528/752] 10.222.0.33 () {58 vars in 1275 bytes} [Thu Jul 28 05:37:16 2022] GET /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:37:16.480838 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-706e53e7-47d9-4234-96cf-e98e42c59cc0 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:16.483167 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-706e53e7-47d9-4234-96cf-e98e42c59cc0 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:16.490756 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-706e53e7-47d9-4234-96cf-e98e42c59cc0 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:16.491209 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-706e53e7-47d9-4234-96cf-e98e42c59cc0 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:16.491979 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-706e53e7-47d9-4234-96cf-e98e42c59cc0 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:16.492404 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-706e53e7-47d9-4234-96cf-e98e42c59cc0 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:16.717719 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-706e53e7-47d9-4234-96cf-e98e42c59cc0 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:16.728384 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-706e53e7-47d9-4234-96cf-e98e42c59cc0 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:16.730278 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-706e53e7-47d9-4234-96cf-e98e42c59cc0 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:16.731730 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-706e53e7-47d9-4234-96cf-e98e42c59cc0 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 200 len: 1725 microversion: 2.20 time: 0.255193 Jul 28 05:37:16.732353 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 529/753] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:37:16 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 1725 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:37:16.738201 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-56ea90e8-9474-4421-a472-6265dd406603 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fda1b7f1-0963-4d37-befe-efcb6f58f83c"}} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:37:16.740828 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-56ea90e8-9474-4421-a472-6265dd406603 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] [instance: 549e692f-7b6f-4ab0-987b-986a1934630e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:16.747091 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-56ea90e8-9474-4421-a472-6265dd406603 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:16.747543 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-56ea90e8-9474-4421-a472-6265dd406603 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:16.749072 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-56ea90e8-9474-4421-a472-6265dd406603 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:16.749535 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-56ea90e8-9474-4421-a472-6265dd406603 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:16.823908 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell1:SELECT=100 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:37:17.593307 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-56ea90e8-9474-4421-a472-6265dd406603 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] 10.222.0.33 "POST /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.859235 Jul 28 05:37:17.610806 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 530/754] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Jul 28 05:37:16 2022] POST /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e/os-volume_attachments => generated 194 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:37:17.620085 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-fc7c8789-c9bf-42a5-9375-1ae98cfb9ec1 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:17.621090 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-fc7c8789-c9bf-42a5-9375-1ae98cfb9ec1 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: 9557131e-b3ea-4672-bdae-75a0c5a120e3] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:17.631399 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-fc7c8789-c9bf-42a5-9375-1ae98cfb9ec1 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:17.631929 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-fc7c8789-c9bf-42a5-9375-1ae98cfb9ec1 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:17.637609 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-fc7c8789-c9bf-42a5-9375-1ae98cfb9ec1 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:17.637609 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-fc7c8789-c9bf-42a5-9375-1ae98cfb9ec1 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:17.952456 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-fc7c8789-c9bf-42a5-9375-1ae98cfb9ec1 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:17.965052 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-fc7c8789-c9bf-42a5-9375-1ae98cfb9ec1 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3" status: 200 len: 1368 microversion: 2.1 time: 0.352547 Jul 28 05:37:17.985576 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 531/755] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:37:17 2022] GET /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3 => generated 1368 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:37:17.993796 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-8c607a50-2614-4713-9476-232a7fc9eec5 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:17.995103 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-8c607a50-2614-4713-9476-232a7fc9eec5 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:18.003991 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8c607a50-2614-4713-9476-232a7fc9eec5 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:18.004452 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8c607a50-2614-4713-9476-232a7fc9eec5 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:18.005413 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8c607a50-2614-4713-9476-232a7fc9eec5 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:18.005884 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8c607a50-2614-4713-9476-232a7fc9eec5 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:18.217743 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-8c607a50-2614-4713-9476-232a7fc9eec5 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:18.223621 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-8c607a50-2614-4713-9476-232a7fc9eec5 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:18.225185 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-8c607a50-2614-4713-9476-232a7fc9eec5 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:18.226431 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-8c607a50-2614-4713-9476-232a7fc9eec5 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 200 len: 1725 microversion: 2.20 time: 0.239735 Jul 28 05:37:18.242004 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 532/756] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:37:17 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 1725 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:37:18.255050 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-d56ac3db-7178-492f-805f-b037a42703cb req-a0847c6f-c5e7-4a30-ab57-44ceda60e75e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4c59c70-b18e-4e7d-ad59-50b0e2e66041", "tag": "6358d70d-ca49-4c50-af18-16013f79bc5a"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:37:18.265275 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-d56ac3db-7178-492f-805f-b037a42703cb req-a0847c6f-c5e7-4a30-ab57-44ceda60e75e service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:18.265788 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-d56ac3db-7178-492f-805f-b037a42703cb req-a0847c6f-c5e7-4a30-ab57-44ceda60e75e service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:18.284114 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-d56ac3db-7178-492f-805f-b037a42703cb req-a0847c6f-c5e7-4a30-ab57-44ceda60e75e service nova] Creating event network-changed:6358d70d-ca49-4c50-af18-16013f79bc5a for instance b4c59c70-b18e-4e7d-ad59-50b0e2e66041 on hv-cinder-79987 Jul 28 05:37:18.304860 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-d56ac3db-7178-492f-805f-b037a42703cb req-a0847c6f-c5e7-4a30-ab57-44ceda60e75e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061414 Jul 28 05:37:18.306439 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 533/757] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:37:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:37:18.668930 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-ae650f6a-a536-4503-aefa-c0bbdc239393 req-fc76a5bf-8a1c-401c-b717-4e89312e68c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9557131e-b3ea-4672-bdae-75a0c5a120e3", "tag": "1fc13072-08e7-4bb8-8f8f-d55569372d0e"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:37:18.681218 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-ae650f6a-a536-4503-aefa-c0bbdc239393 req-fc76a5bf-8a1c-401c-b717-4e89312e68c5 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:18.687622 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-ae650f6a-a536-4503-aefa-c0bbdc239393 req-fc76a5bf-8a1c-401c-b717-4e89312e68c5 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:18.699625 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-ae650f6a-a536-4503-aefa-c0bbdc239393 req-fc76a5bf-8a1c-401c-b717-4e89312e68c5 service nova] Creating event network-changed:1fc13072-08e7-4bb8-8f8f-d55569372d0e for instance 9557131e-b3ea-4672-bdae-75a0c5a120e3 on hv-cinder-79987 Jul 28 05:37:18.705685 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-ae650f6a-a536-4503-aefa-c0bbdc239393 req-fc76a5bf-8a1c-401c-b717-4e89312e68c5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041020 Jul 28 05:37:18.706304 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 534/758] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:37:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:37:18.988535 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-906cfc1e-a130-4086-8622-763785a08324 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:18.989370 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-906cfc1e-a130-4086-8622-763785a08324 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: 9557131e-b3ea-4672-bdae-75a0c5a120e3] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:18.995977 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-906cfc1e-a130-4086-8622-763785a08324 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:18.996426 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-906cfc1e-a130-4086-8622-763785a08324 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:18.997941 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-906cfc1e-a130-4086-8622-763785a08324 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:18.998528 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-906cfc1e-a130-4086-8622-763785a08324 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:19.132074 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-906cfc1e-a130-4086-8622-763785a08324 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:19.141386 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-906cfc1e-a130-4086-8622-763785a08324 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3" status: 200 len: 1368 microversion: 2.1 time: 0.157105 Jul 28 05:37:19.141999 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 535/759] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:37:18 2022] GET /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:37:19.259781 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-491f8ce8-af4d-4eb4-bb86-13d52396a380 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:19.260386 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-491f8ce8-af4d-4eb4-bb86-13d52396a380 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:19.267284 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-491f8ce8-af4d-4eb4-bb86-13d52396a380 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:19.268056 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-491f8ce8-af4d-4eb4-bb86-13d52396a380 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:19.268818 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-491f8ce8-af4d-4eb4-bb86-13d52396a380 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:19.269244 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-491f8ce8-af4d-4eb4-bb86-13d52396a380 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:19.396948 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-491f8ce8-af4d-4eb4-bb86-13d52396a380 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:19.404778 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-491f8ce8-af4d-4eb4-bb86-13d52396a380 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:19.406302 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-491f8ce8-af4d-4eb4-bb86-13d52396a380 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:19.407452 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-491f8ce8-af4d-4eb4-bb86-13d52396a380 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 200 len: 1725 microversion: 2.20 time: 0.151712 Jul 28 05:37:19.408041 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 536/760] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:37:19 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 05:37:20.163501 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-00c47199-f914-4e18-a9e2-d842fde2ba7c tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:20.164175 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-00c47199-f914-4e18-a9e2-d842fde2ba7c tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: 9557131e-b3ea-4672-bdae-75a0c5a120e3] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:20.170944 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-00c47199-f914-4e18-a9e2-d842fde2ba7c tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:20.171396 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-00c47199-f914-4e18-a9e2-d842fde2ba7c tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:20.172158 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-00c47199-f914-4e18-a9e2-d842fde2ba7c tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:20.172594 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-00c47199-f914-4e18-a9e2-d842fde2ba7c tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:20.308606 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-00c47199-f914-4e18-a9e2-d842fde2ba7c tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:20.316754 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-00c47199-f914-4e18-a9e2-d842fde2ba7c tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3" status: 200 len: 1368 microversion: 2.1 time: 0.157154 Jul 28 05:37:20.319174 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 537/761] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:37:20 2022] GET /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3 => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:37:20.430269 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-527200f3-5a55-4f45-bc9f-713f40d9370b tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:20.430897 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-527200f3-5a55-4f45-bc9f-713f40d9370b tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:20.437654 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-527200f3-5a55-4f45-bc9f-713f40d9370b tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:20.438095 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-527200f3-5a55-4f45-bc9f-713f40d9370b tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:20.438857 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-527200f3-5a55-4f45-bc9f-713f40d9370b tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:20.439287 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-527200f3-5a55-4f45-bc9f-713f40d9370b tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:20.567751 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-527200f3-5a55-4f45-bc9f-713f40d9370b tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:20.575927 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-527200f3-5a55-4f45-bc9f-713f40d9370b tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:20.577447 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-527200f3-5a55-4f45-bc9f-713f40d9370b tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:20.578636 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-527200f3-5a55-4f45-bc9f-713f40d9370b tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 200 len: 1746 microversion: 2.20 time: 0.152325 Jul 28 05:37:20.579211 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 538/762] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:37:20 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 05:37:21.339625 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-885a6dfa-ca87-4456-a491-2fd2e4d8e3b1 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:21.340258 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-885a6dfa-ca87-4456-a491-2fd2e4d8e3b1 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: 9557131e-b3ea-4672-bdae-75a0c5a120e3] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:21.348083 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-885a6dfa-ca87-4456-a491-2fd2e4d8e3b1 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:21.348083 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-885a6dfa-ca87-4456-a491-2fd2e4d8e3b1 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:21.352049 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-885a6dfa-ca87-4456-a491-2fd2e4d8e3b1 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:21.352049 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-885a6dfa-ca87-4456-a491-2fd2e4d8e3b1 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:21.574822 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-885a6dfa-ca87-4456-a491-2fd2e4d8e3b1 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:21.582856 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-885a6dfa-ca87-4456-a491-2fd2e4d8e3b1 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3" status: 200 len: 1368 microversion: 2.1 time: 0.247435 Jul 28 05:37:21.583434 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 539/763] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:37:21 2022] GET /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3 => generated 1368 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:37:21.602959 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-5536d39f-2dab-4bec-ac4e-5020fe818293 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:21.603578 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-5536d39f-2dab-4bec-ac4e-5020fe818293 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:21.610839 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5536d39f-2dab-4bec-ac4e-5020fe818293 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:21.611294 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5536d39f-2dab-4bec-ac4e-5020fe818293 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:21.612075 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5536d39f-2dab-4bec-ac4e-5020fe818293 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:21.612514 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5536d39f-2dab-4bec-ac4e-5020fe818293 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:21.839310 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-5536d39f-2dab-4bec-ac4e-5020fe818293 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:21.847263 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-5536d39f-2dab-4bec-ac4e-5020fe818293 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:21.848773 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-5536d39f-2dab-4bec-ac4e-5020fe818293 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:21.849969 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-5536d39f-2dab-4bec-ac4e-5020fe818293 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 200 len: 1746 microversion: 2.20 time: 0.251060 Jul 28 05:37:21.850537 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 540/764] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:37:21 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 1746 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 05:37:22.603961 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-73c71b16-ec81-47c7-bccc-282293811ff1 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:22.604586 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-73c71b16-ec81-47c7-bccc-282293811ff1 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: 9557131e-b3ea-4672-bdae-75a0c5a120e3] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:22.612497 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-73c71b16-ec81-47c7-bccc-282293811ff1 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:22.612943 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-73c71b16-ec81-47c7-bccc-282293811ff1 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:22.613726 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-73c71b16-ec81-47c7-bccc-282293811ff1 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:22.614156 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-73c71b16-ec81-47c7-bccc-282293811ff1 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:22.756332 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-73c71b16-ec81-47c7-bccc-282293811ff1 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:22.764673 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-73c71b16-ec81-47c7-bccc-282293811ff1 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3" status: 200 len: 1368 microversion: 2.1 time: 0.164502 Jul 28 05:37:22.765250 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 541/765] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:37:22 2022] GET /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3 => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:37:22.872958 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-5fcb6e60-814c-4461-b016-57ae5318a41b tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:22.873513 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-5fcb6e60-814c-4461-b016-57ae5318a41b tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:22.879827 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5fcb6e60-814c-4461-b016-57ae5318a41b tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:22.880320 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5fcb6e60-814c-4461-b016-57ae5318a41b tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:22.881083 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5fcb6e60-814c-4461-b016-57ae5318a41b tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:22.881546 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5fcb6e60-814c-4461-b016-57ae5318a41b tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:23.018583 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-5fcb6e60-814c-4461-b016-57ae5318a41b tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:23.028864 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-5fcb6e60-814c-4461-b016-57ae5318a41b tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:23.030565 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-5fcb6e60-814c-4461-b016-57ae5318a41b tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:23.031821 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-5fcb6e60-814c-4461-b016-57ae5318a41b tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 200 len: 1746 microversion: 2.20 time: 0.163529 Jul 28 05:37:23.032390 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 542/766] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:37:22 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 1746 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 05:37:23.786163 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-204ddcb5-4558-4243-9b27-4fda28e806a9 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:23.786821 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-204ddcb5-4558-4243-9b27-4fda28e806a9 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: 9557131e-b3ea-4672-bdae-75a0c5a120e3] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:23.794663 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-204ddcb5-4558-4243-9b27-4fda28e806a9 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:23.794936 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-204ddcb5-4558-4243-9b27-4fda28e806a9 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:23.795721 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-204ddcb5-4558-4243-9b27-4fda28e806a9 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:23.796160 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-204ddcb5-4558-4243-9b27-4fda28e806a9 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:23.917332 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell0:SELECT=12 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:37:23.929555 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-204ddcb5-4558-4243-9b27-4fda28e806a9 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:23.937093 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-204ddcb5-4558-4243-9b27-4fda28e806a9 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3" status: 200 len: 1368 microversion: 2.1 time: 0.155166 Jul 28 05:37:23.938959 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 543/767] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:37:23 2022] GET /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:37:24.073547 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-e1309f3f-7b8a-472f-b015-fd5ca01b8bc0 req-f8af33a5-d43b-41d3-b932-9b543567567a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54986322-1272-4f12-a108-b8675f3190a6", "name": "network-vif-plugged", "status": "completed", "tag": "bb48c226-cd8a-426b-8392-6dcb3d411b85"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:37:24.087592 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-e1309f3f-7b8a-472f-b015-fd5ca01b8bc0 req-f8af33a5-d43b-41d3-b932-9b543567567a service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:24.089594 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-e1309f3f-7b8a-472f-b015-fd5ca01b8bc0 req-f8af33a5-d43b-41d3-b932-9b543567567a service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:24.100425 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-e1309f3f-7b8a-472f-b015-fd5ca01b8bc0 req-f8af33a5-d43b-41d3-b932-9b543567567a service nova] Creating event network-vif-plugged:bb48c226-cd8a-426b-8392-6dcb3d411b85 for instance 54986322-1272-4f12-a108-b8675f3190a6 on hv-cinder-79987 Jul 28 05:37:24.105306 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-e1309f3f-7b8a-472f-b015-fd5ca01b8bc0 req-f8af33a5-d43b-41d3-b932-9b543567567a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166125 Jul 28 05:37:24.105945 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 544/768] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:37:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:37:24.111553 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-0ad436a6-f225-42c5-abcc-c2f25ee8d5e8 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:24.112243 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-0ad436a6-f225-42c5-abcc-c2f25ee8d5e8 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:24.121355 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-0ad436a6-f225-42c5-abcc-c2f25ee8d5e8 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:24.121355 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-0ad436a6-f225-42c5-abcc-c2f25ee8d5e8 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:24.121355 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-0ad436a6-f225-42c5-abcc-c2f25ee8d5e8 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:24.121355 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-0ad436a6-f225-42c5-abcc-c2f25ee8d5e8 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:24.253551 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-0ad436a6-f225-42c5-abcc-c2f25ee8d5e8 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:24.261641 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-0ad436a6-f225-42c5-abcc-c2f25ee8d5e8 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:24.263685 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-0ad436a6-f225-42c5-abcc-c2f25ee8d5e8 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:24.264841 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-0ad436a6-f225-42c5-abcc-c2f25ee8d5e8 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 200 len: 1746 microversion: 2.20 time: 0.157193 Jul 28 05:37:24.265395 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 545/769] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:37:24 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 1746 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:37:24.958953 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-3ce2a97b-94aa-43f6-9d4d-ac448e1e3409 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:24.959561 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-3ce2a97b-94aa-43f6-9d4d-ac448e1e3409 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: 9557131e-b3ea-4672-bdae-75a0c5a120e3] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:24.961574 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell0:SELECT=4 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:37:24.966926 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3ce2a97b-94aa-43f6-9d4d-ac448e1e3409 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:24.967370 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3ce2a97b-94aa-43f6-9d4d-ac448e1e3409 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:24.968244 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3ce2a97b-94aa-43f6-9d4d-ac448e1e3409 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:24.968679 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3ce2a97b-94aa-43f6-9d4d-ac448e1e3409 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:25.105800 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-3ce2a97b-94aa-43f6-9d4d-ac448e1e3409 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:25.114116 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-3ce2a97b-94aa-43f6-9d4d-ac448e1e3409 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3" status: 200 len: 1368 microversion: 2.1 time: 0.159064 Jul 28 05:37:25.114685 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 546/770] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:37:24 2022] GET /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:37:25.288263 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-76388d30-5355-4b16-bbce-19a1d943fc3e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:25.288928 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-76388d30-5355-4b16-bbce-19a1d943fc3e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:25.294959 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-76388d30-5355-4b16-bbce-19a1d943fc3e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:25.295408 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-76388d30-5355-4b16-bbce-19a1d943fc3e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:25.296158 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-76388d30-5355-4b16-bbce-19a1d943fc3e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:25.296621 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-76388d30-5355-4b16-bbce-19a1d943fc3e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:25.424575 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-76388d30-5355-4b16-bbce-19a1d943fc3e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:25.432822 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-76388d30-5355-4b16-bbce-19a1d943fc3e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:25.434360 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-76388d30-5355-4b16-bbce-19a1d943fc3e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:25.436153 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-76388d30-5355-4b16-bbce-19a1d943fc3e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 200 len: 1746 microversion: 2.20 time: 0.151197 Jul 28 05:37:25.437052 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 547/771] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:37:25 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 1746 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 05:37:26.134739 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-90251c63-c4b6-428c-84a3-89cd18008388 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:26.135353 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-90251c63-c4b6-428c-84a3-89cd18008388 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: 9557131e-b3ea-4672-bdae-75a0c5a120e3] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:26.142421 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-90251c63-c4b6-428c-84a3-89cd18008388 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:26.142871 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-90251c63-c4b6-428c-84a3-89cd18008388 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:26.143641 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-90251c63-c4b6-428c-84a3-89cd18008388 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:26.144078 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-90251c63-c4b6-428c-84a3-89cd18008388 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:26.147092 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:37:26.277953 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-90251c63-c4b6-428c-84a3-89cd18008388 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:26.286068 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-90251c63-c4b6-428c-84a3-89cd18008388 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3" status: 200 len: 1368 microversion: 2.1 time: 0.155146 Jul 28 05:37:26.286637 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 548/772] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:37:26 2022] GET /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:37:26.460053 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-3be89404-0f9c-49e4-a460-34f7ce79d1f5 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:26.460580 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-3be89404-0f9c-49e4-a460-34f7ce79d1f5 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:26.467396 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3be89404-0f9c-49e4-a460-34f7ce79d1f5 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:26.467897 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3be89404-0f9c-49e4-a460-34f7ce79d1f5 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:26.468647 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3be89404-0f9c-49e4-a460-34f7ce79d1f5 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:26.469081 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3be89404-0f9c-49e4-a460-34f7ce79d1f5 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:26.598287 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-3be89404-0f9c-49e4-a460-34f7ce79d1f5 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:26.606081 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-3be89404-0f9c-49e4-a460-34f7ce79d1f5 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:26.608192 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-3be89404-0f9c-49e4-a460-34f7ce79d1f5 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:26.609410 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-3be89404-0f9c-49e4-a460-34f7ce79d1f5 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 200 len: 1746 microversion: 2.20 time: 0.153219 Jul 28 05:37:26.610011 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 549/773] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:37:26 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 05:37:27.307909 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-3ccded30-ade5-4ae8-9864-ce867e178eb6 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:27.308548 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-3ccded30-ade5-4ae8-9864-ce867e178eb6 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: 9557131e-b3ea-4672-bdae-75a0c5a120e3] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:27.315090 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3ccded30-ade5-4ae8-9864-ce867e178eb6 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:27.315532 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3ccded30-ade5-4ae8-9864-ce867e178eb6 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:27.316289 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3ccded30-ade5-4ae8-9864-ce867e178eb6 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:27.316756 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3ccded30-ade5-4ae8-9864-ce867e178eb6 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:27.455394 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-3ccded30-ade5-4ae8-9864-ce867e178eb6 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:27.463082 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-3ccded30-ade5-4ae8-9864-ce867e178eb6 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3" status: 200 len: 1368 microversion: 2.1 time: 0.158939 Jul 28 05:37:27.463447 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 550/774] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:37:27 2022] GET /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:37:27.632424 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-671c505d-8705-46b4-9681-87e580b53cb8 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:27.633089 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-671c505d-8705-46b4-9681-87e580b53cb8 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:27.639820 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-671c505d-8705-46b4-9681-87e580b53cb8 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:27.640264 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-671c505d-8705-46b4-9681-87e580b53cb8 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:27.641009 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-671c505d-8705-46b4-9681-87e580b53cb8 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:27.641438 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-671c505d-8705-46b4-9681-87e580b53cb8 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:27.775400 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-671c505d-8705-46b4-9681-87e580b53cb8 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:27.783433 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-671c505d-8705-46b4-9681-87e580b53cb8 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:27.784923 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-671c505d-8705-46b4-9681-87e580b53cb8 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:27.786099 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-671c505d-8705-46b4-9681-87e580b53cb8 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 200 len: 1741 microversion: 2.20 time: 0.157530 Jul 28 05:37:27.786650 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 551/775] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:37:27 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 1741 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:37:28.474386 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-05696fc3-91f1-468c-a4b4-4f1c7239be19 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:28.475002 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-05696fc3-91f1-468c-a4b4-4f1c7239be19 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] [instance: 549e692f-7b6f-4ab0-987b-986a1934630e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:28.485049 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-05696fc3-91f1-468c-a4b4-4f1c7239be19 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:28.486361 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-05696fc3-91f1-468c-a4b4-4f1c7239be19 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:28.488319 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-05696fc3-91f1-468c-a4b4-4f1c7239be19 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:28.489051 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-05696fc3-91f1-468c-a4b4-4f1c7239be19 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:28.639413 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-05696fc3-91f1-468c-a4b4-4f1c7239be19 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d859e797d874c948325f2ce0978edb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5989fabc615545eeb4ef987dea566175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:28.650991 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-05696fc3-91f1-468c-a4b4-4f1c7239be19 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] 10.222.0.33 "GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e" status: 200 len: 1595 microversion: 2.1 time: 0.181098 Jul 28 05:37:28.651805 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 552/776] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:37:28 2022] GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e => generated 1595 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:37:28.657748 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-5468fb8f-54e6-47b5-af39-de4efae891b3 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:28.659043 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-5468fb8f-54e6-47b5-af39-de4efae891b3 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: 9557131e-b3ea-4672-bdae-75a0c5a120e3] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:28.668849 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5468fb8f-54e6-47b5-af39-de4efae891b3 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:28.669586 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5468fb8f-54e6-47b5-af39-de4efae891b3 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:28.670569 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5468fb8f-54e6-47b5-af39-de4efae891b3 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:28.671664 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5468fb8f-54e6-47b5-af39-de4efae891b3 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:28.870121 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-5468fb8f-54e6-47b5-af39-de4efae891b3 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:28.878983 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-5468fb8f-54e6-47b5-af39-de4efae891b3 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3" status: 200 len: 1368 microversion: 2.1 time: 0.225634 Jul 28 05:37:28.879806 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 553/777] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:37:28 2022] GET /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3 => generated 1368 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:37:28.884674 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-64c85e7a-7efb-4b56-9e2e-b344acae89d2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:28.885509 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-64c85e7a-7efb-4b56-9e2e-b344acae89d2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:28.892307 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-64c85e7a-7efb-4b56-9e2e-b344acae89d2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:28.892917 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-64c85e7a-7efb-4b56-9e2e-b344acae89d2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:28.894005 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-64c85e7a-7efb-4b56-9e2e-b344acae89d2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:28.895072 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-64c85e7a-7efb-4b56-9e2e-b344acae89d2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:29.095920 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-64c85e7a-7efb-4b56-9e2e-b344acae89d2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:29.108695 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-64c85e7a-7efb-4b56-9e2e-b344acae89d2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:29.110567 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-64c85e7a-7efb-4b56-9e2e-b344acae89d2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:29.112010 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-64c85e7a-7efb-4b56-9e2e-b344acae89d2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 200 len: 1741 microversion: 2.20 time: 0.231287 Jul 28 05:37:29.126485 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 554/778] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:37:28 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 1741 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:37:29.146874 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-56f86109-5d54-416a-8ee1-58c4e65b081b req-d6c06bab-a480-44b5-aab3-b88a1ce9eee6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9557131e-b3ea-4672-bdae-75a0c5a120e3", "name": "network-vif-plugged", "status": "completed", "tag": "1fc13072-08e7-4bb8-8f8f-d55569372d0e"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:37:29.160843 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-56f86109-5d54-416a-8ee1-58c4e65b081b req-d6c06bab-a480-44b5-aab3-b88a1ce9eee6 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:29.161291 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-56f86109-5d54-416a-8ee1-58c4e65b081b req-d6c06bab-a480-44b5-aab3-b88a1ce9eee6 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:29.177638 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-56f86109-5d54-416a-8ee1-58c4e65b081b req-d6c06bab-a480-44b5-aab3-b88a1ce9eee6 service nova] Creating event network-vif-plugged:1fc13072-08e7-4bb8-8f8f-d55569372d0e for instance 9557131e-b3ea-4672-bdae-75a0c5a120e3 on hv-cinder-79987 Jul 28 05:37:29.182978 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-56f86109-5d54-416a-8ee1-58c4e65b081b req-d6c06bab-a480-44b5-aab3-b88a1ce9eee6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040606 Jul 28 05:37:29.183972 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 555/779] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:37:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:37:29.901911 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-bab6a9fd-2a5c-4a72-8f63-b882e8699302 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:29.903449 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-bab6a9fd-2a5c-4a72-8f63-b882e8699302 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: 9557131e-b3ea-4672-bdae-75a0c5a120e3] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:29.911022 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-bab6a9fd-2a5c-4a72-8f63-b882e8699302 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:29.911913 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-bab6a9fd-2a5c-4a72-8f63-b882e8699302 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:29.913257 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-bab6a9fd-2a5c-4a72-8f63-b882e8699302 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:29.913876 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-bab6a9fd-2a5c-4a72-8f63-b882e8699302 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:30.075202 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-bab6a9fd-2a5c-4a72-8f63-b882e8699302 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:30.084791 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-bab6a9fd-2a5c-4a72-8f63-b882e8699302 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3" status: 200 len: 1368 microversion: 2.1 time: 0.187603 Jul 28 05:37:30.085383 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 556/780] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:37:29 2022] GET /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3 => generated 1368 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:37:30.138912 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-b2a96060-4cca-4492-951f-ee27e0ddb0b2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:30.139921 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-b2a96060-4cca-4492-951f-ee27e0ddb0b2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:30.141942 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:37:30.147252 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b2a96060-4cca-4492-951f-ee27e0ddb0b2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:30.147889 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b2a96060-4cca-4492-951f-ee27e0ddb0b2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:30.148965 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b2a96060-4cca-4492-951f-ee27e0ddb0b2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:30.149753 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b2a96060-4cca-4492-951f-ee27e0ddb0b2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:30.403631 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-b2a96060-4cca-4492-951f-ee27e0ddb0b2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:30.411937 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-b2a96060-4cca-4492-951f-ee27e0ddb0b2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:30.413583 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-b2a96060-4cca-4492-951f-ee27e0ddb0b2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:30.414797 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-b2a96060-4cca-4492-951f-ee27e0ddb0b2 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 200 len: 1741 microversion: 2.20 time: 0.280595 Jul 28 05:37:30.415360 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 557/781] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:37:30 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 1741 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 05:37:31.110338 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-1452a17e-7e96-49ed-8fbb-30d00159d8cb tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:31.111148 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-1452a17e-7e96-49ed-8fbb-30d00159d8cb tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: 9557131e-b3ea-4672-bdae-75a0c5a120e3] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:31.118630 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1452a17e-7e96-49ed-8fbb-30d00159d8cb tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:31.119082 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1452a17e-7e96-49ed-8fbb-30d00159d8cb tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:31.119859 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1452a17e-7e96-49ed-8fbb-30d00159d8cb tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:31.120294 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1452a17e-7e96-49ed-8fbb-30d00159d8cb tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:31.259564 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-1452a17e-7e96-49ed-8fbb-30d00159d8cb tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:31.268411 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-1452a17e-7e96-49ed-8fbb-30d00159d8cb tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3" status: 200 len: 1368 microversion: 2.1 time: 0.164084 Jul 28 05:37:31.270020 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 558/782] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:37:31 2022] GET /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3 => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:37:31.439377 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-90c40a52-481e-4b95-ae1b-cce4286c2986 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:31.440031 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-90c40a52-481e-4b95-ae1b-cce4286c2986 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:31.449026 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-90c40a52-481e-4b95-ae1b-cce4286c2986 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:31.449590 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-90c40a52-481e-4b95-ae1b-cce4286c2986 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:31.450443 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-90c40a52-481e-4b95-ae1b-cce4286c2986 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:31.452057 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-90c40a52-481e-4b95-ae1b-cce4286c2986 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:31.591700 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-90c40a52-481e-4b95-ae1b-cce4286c2986 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:31.602639 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-90c40a52-481e-4b95-ae1b-cce4286c2986 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:31.604582 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-90c40a52-481e-4b95-ae1b-cce4286c2986 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:31.605841 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-90c40a52-481e-4b95-ae1b-cce4286c2986 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 200 len: 1741 microversion: 2.20 time: 0.171390 Jul 28 05:37:31.617821 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 559/783] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:37:31 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 1741 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:37:32.061800 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-7aa7d79e-bbbc-4e3e-98c3-64f9721fabb2 req-ba1b2270-0127-457d-ae11-7c30efe29825 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "549e692f-7b6f-4ab0-987b-986a1934630e", "tag": "b49100c3-29f8-45db-910f-805da59e6250"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:37:32.072956 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-7aa7d79e-bbbc-4e3e-98c3-64f9721fabb2 req-ba1b2270-0127-457d-ae11-7c30efe29825 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:32.073592 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-7aa7d79e-bbbc-4e3e-98c3-64f9721fabb2 req-ba1b2270-0127-457d-ae11-7c30efe29825 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:32.088000 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-7aa7d79e-bbbc-4e3e-98c3-64f9721fabb2 req-ba1b2270-0127-457d-ae11-7c30efe29825 service nova] Creating event network-changed:b49100c3-29f8-45db-910f-805da59e6250 for instance 549e692f-7b6f-4ab0-987b-986a1934630e on hv-cinder-79987 Jul 28 05:37:32.095037 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-7aa7d79e-bbbc-4e3e-98c3-64f9721fabb2 req-ba1b2270-0127-457d-ae11-7c30efe29825 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036895 Jul 28 05:37:32.095258 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 560/784] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 05:37:32.292333 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-5757bfca-bec0-4d0d-8378-b87cd85a9f2b tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:32.293246 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-5757bfca-bec0-4d0d-8378-b87cd85a9f2b tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: 9557131e-b3ea-4672-bdae-75a0c5a120e3] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:32.302342 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5757bfca-bec0-4d0d-8378-b87cd85a9f2b tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:32.302847 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5757bfca-bec0-4d0d-8378-b87cd85a9f2b tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:32.303819 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5757bfca-bec0-4d0d-8378-b87cd85a9f2b tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:32.304310 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5757bfca-bec0-4d0d-8378-b87cd85a9f2b tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:32.501615 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-5757bfca-bec0-4d0d-8378-b87cd85a9f2b tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:32.510077 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-5757bfca-bec0-4d0d-8378-b87cd85a9f2b tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3" status: 200 len: 1368 microversion: 2.1 time: 0.223381 Jul 28 05:37:32.527038 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 561/785] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:37:32 2022] GET /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3 => generated 1368 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:37:32.632725 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-94d2c93d-f94b-4c82-8e44-11d4616e2d5d tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:32.633354 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-94d2c93d-f94b-4c82-8e44-11d4616e2d5d tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:32.645183 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-94d2c93d-f94b-4c82-8e44-11d4616e2d5d tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:32.645667 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-94d2c93d-f94b-4c82-8e44-11d4616e2d5d tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:32.646449 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-94d2c93d-f94b-4c82-8e44-11d4616e2d5d tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:32.646888 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-94d2c93d-f94b-4c82-8e44-11d4616e2d5d tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:32.846026 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-94d2c93d-f94b-4c82-8e44-11d4616e2d5d tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:32.854606 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-94d2c93d-f94b-4c82-8e44-11d4616e2d5d tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:32.856218 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-94d2c93d-f94b-4c82-8e44-11d4616e2d5d tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:32.858307 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-94d2c93d-f94b-4c82-8e44-11d4616e2d5d tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 200 len: 1741 microversion: 2.20 time: 0.232036 Jul 28 05:37:32.875172 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 562/786] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:37:32 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 1741 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 05:37:33.535356 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-8594b945-ce63-4288-a9fd-77e221a8daa0 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:33.536770 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-8594b945-ce63-4288-a9fd-77e221a8daa0 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: 9557131e-b3ea-4672-bdae-75a0c5a120e3] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:33.543935 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8594b945-ce63-4288-a9fd-77e221a8daa0 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:33.544334 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8594b945-ce63-4288-a9fd-77e221a8daa0 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:33.545366 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8594b945-ce63-4288-a9fd-77e221a8daa0 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:33.546311 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8594b945-ce63-4288-a9fd-77e221a8daa0 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:33.718337 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-8594b945-ce63-4288-a9fd-77e221a8daa0 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:33.729118 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-8594b945-ce63-4288-a9fd-77e221a8daa0 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3" status: 200 len: 1368 microversion: 2.1 time: 0.197476 Jul 28 05:37:33.736184 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 563/787] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:37:33 2022] GET /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3 => generated 1368 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:37:33.885661 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-8becd63c-ba8b-4401-9df1-5997decc5e9b tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:33.890062 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-8becd63c-ba8b-4401-9df1-5997decc5e9b tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:33.897347 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8becd63c-ba8b-4401-9df1-5997decc5e9b tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:33.898174 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8becd63c-ba8b-4401-9df1-5997decc5e9b tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:33.899244 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8becd63c-ba8b-4401-9df1-5997decc5e9b tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:33.899950 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8becd63c-ba8b-4401-9df1-5997decc5e9b tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:34.127347 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-8becd63c-ba8b-4401-9df1-5997decc5e9b tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:34.137589 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-8becd63c-ba8b-4401-9df1-5997decc5e9b tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:34.140528 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-8becd63c-ba8b-4401-9df1-5997decc5e9b tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:34.142029 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-8becd63c-ba8b-4401-9df1-5997decc5e9b tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 200 len: 1741 microversion: 2.20 time: 0.262346 Jul 28 05:37:34.142814 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 564/788] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:37:33 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 1741 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:37:34.752496 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-f49728f7-8996-456d-8ead-88a028665c74 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:34.753318 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-f49728f7-8996-456d-8ead-88a028665c74 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: 9557131e-b3ea-4672-bdae-75a0c5a120e3] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:34.759854 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f49728f7-8996-456d-8ead-88a028665c74 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:34.760298 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f49728f7-8996-456d-8ead-88a028665c74 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:34.761054 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f49728f7-8996-456d-8ead-88a028665c74 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:34.761500 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f49728f7-8996-456d-8ead-88a028665c74 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:35.009602 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-f49728f7-8996-456d-8ead-88a028665c74 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:35.026357 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-f49728f7-8996-456d-8ead-88a028665c74 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3" status: 200 len: 1558 microversion: 2.1 time: 0.277698 Jul 28 05:37:35.027423 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 565/789] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:37:34 2022] GET /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3 => generated 1558 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:37:35.047590 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-ab6a8ca7-5626-4fde-b966-5a4b262b05b9 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:35.048323 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-ab6a8ca7-5626-4fde-b966-5a4b262b05b9 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: 9557131e-b3ea-4672-bdae-75a0c5a120e3] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:35.055692 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ab6a8ca7-5626-4fde-b966-5a4b262b05b9 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:35.056214 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ab6a8ca7-5626-4fde-b966-5a4b262b05b9 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:35.057052 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ab6a8ca7-5626-4fde-b966-5a4b262b05b9 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:35.057583 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ab6a8ca7-5626-4fde-b966-5a4b262b05b9 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:35.065611 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell1:SELECT=100 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:37:35.167756 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-ab6a8ca7-5626-4fde-b966-5a4b262b05b9 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.123908 Jul 28 05:37:35.169518 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 566/790] 10.222.0.33 () {58 vars in 1275 bytes} [Thu Jul 28 05:37:35 2022] GET /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3/os-interface => generated 284 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 05:37:35.177780 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-297fe03f-7237-4f40-a210-f6262aad4b04 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:35.178784 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-297fe03f-7237-4f40-a210-f6262aad4b04 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:35.186230 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-297fe03f-7237-4f40-a210-f6262aad4b04 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:35.186793 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-297fe03f-7237-4f40-a210-f6262aad4b04 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:35.187793 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-297fe03f-7237-4f40-a210-f6262aad4b04 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:35.188438 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-297fe03f-7237-4f40-a210-f6262aad4b04 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:35.513422 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-297fe03f-7237-4f40-a210-f6262aad4b04 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:35.531073 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-297fe03f-7237-4f40-a210-f6262aad4b04 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:35.533050 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-297fe03f-7237-4f40-a210-f6262aad4b04 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:35.534287 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-297fe03f-7237-4f40-a210-f6262aad4b04 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 200 len: 1741 microversion: 2.20 time: 0.363679 Jul 28 05:37:35.534856 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 567/791] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:37:35 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 1741 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:37:35.819988 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-319103bd-c609-4027-b216-e72db5192880 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1541881698"}} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:37:35.822424 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-319103bd-c609-4027-b216-e72db5192880 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] [instance: 549e692f-7b6f-4ab0-987b-986a1934630e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:35.832710 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-319103bd-c609-4027-b216-e72db5192880 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:35.840453 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-319103bd-c609-4027-b216-e72db5192880 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:35.845975 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-319103bd-c609-4027-b216-e72db5192880 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:35.845975 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-319103bd-c609-4027-b216-e72db5192880 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:36.028198 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.network.security_group_api [None req-319103bd-c609-4027-b216-e72db5192880 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Adding security group 67629efd-defe-468a-8cc4-0b3911b29ce3 to port b49100c3-29f8-45db-910f-805da59e6250 Jul 28 05:37:36.674206 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-319103bd-c609-4027-b216-e72db5192880 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] 10.222.0.33 "POST /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e/action" status: 202 len: 0 microversion: 2.1 time: 0.859855 Jul 28 05:37:36.675188 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 568/792] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Jul 28 05:37:35 2022] POST /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e/action => generated 0 bytes in 861 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 05:37:36.681903 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-28d5b1a1-e73b-4841-b3f9-c2615af3a481 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:36.682654 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-28d5b1a1-e73b-4841-b3f9-c2615af3a481 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:36.697429 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-28d5b1a1-e73b-4841-b3f9-c2615af3a481 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:36.697911 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-28d5b1a1-e73b-4841-b3f9-c2615af3a481 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:36.698692 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-28d5b1a1-e73b-4841-b3f9-c2615af3a481 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:36.699121 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-28d5b1a1-e73b-4841-b3f9-c2615af3a481 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:37.047130 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-28d5b1a1-e73b-4841-b3f9-c2615af3a481 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:37.060077 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-28d5b1a1-e73b-4841-b3f9-c2615af3a481 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:37.065697 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-28d5b1a1-e73b-4841-b3f9-c2615af3a481 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:37.071921 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-28d5b1a1-e73b-4841-b3f9-c2615af3a481 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 200 len: 1741 microversion: 2.20 time: 0.394663 Jul 28 05:37:37.073369 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 569/793] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:37:36 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 1741 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:37:37.080243 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-ac4e2e61-ccb8-4f51-a183-66e198ee0841 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:37.081161 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-ac4e2e61-ccb8-4f51-a183-66e198ee0841 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] [instance: 549e692f-7b6f-4ab0-987b-986a1934630e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:37.089215 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ac4e2e61-ccb8-4f51-a183-66e198ee0841 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:37.089975 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ac4e2e61-ccb8-4f51-a183-66e198ee0841 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:37.091117 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ac4e2e61-ccb8-4f51-a183-66e198ee0841 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:37.092665 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ac4e2e61-ccb8-4f51-a183-66e198ee0841 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:37.279510 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-ac4e2e61-ccb8-4f51-a183-66e198ee0841 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d859e797d874c948325f2ce0978edb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5989fabc615545eeb4ef987dea566175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:37.291846 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-ac4e2e61-ccb8-4f51-a183-66e198ee0841 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] 10.222.0.33 "GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e" status: 200 len: 1761 microversion: 2.1 time: 0.216974 Jul 28 05:37:37.292891 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 570/794] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:37:37 2022] GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e => generated 1761 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:37:37.317188 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-0e24ddbf-45f6-4051-b4fb-727e88160da1 req-9e1099e1-208f-461b-ba80-42536fa783a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "549e692f-7b6f-4ab0-987b-986a1934630e", "tag": "b49100c3-29f8-45db-910f-805da59e6250"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:37:37.328012 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-0e24ddbf-45f6-4051-b4fb-727e88160da1 req-9e1099e1-208f-461b-ba80-42536fa783a8 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:37.329054 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-0e24ddbf-45f6-4051-b4fb-727e88160da1 req-9e1099e1-208f-461b-ba80-42536fa783a8 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:37.344665 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-0e24ddbf-45f6-4051-b4fb-727e88160da1 req-9e1099e1-208f-461b-ba80-42536fa783a8 service nova] Creating event network-changed:b49100c3-29f8-45db-910f-805da59e6250 for instance 549e692f-7b6f-4ab0-987b-986a1934630e on hv-cinder-79987 Jul 28 05:37:37.350963 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-0e24ddbf-45f6-4051-b4fb-727e88160da1 req-9e1099e1-208f-461b-ba80-42536fa783a8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041699 Jul 28 05:37:37.352126 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 571/795] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:37:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:37:37.366677 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-14074b86-6398-4f35-b2b5-750e0009d987 req-589a7ce6-9937-4549-873c-98331b156e8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9557131e-b3ea-4672-bdae-75a0c5a120e3", "tag": "1fc13072-08e7-4bb8-8f8f-d55569372d0e"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:37:37.376436 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-14074b86-6398-4f35-b2b5-750e0009d987 req-589a7ce6-9937-4549-873c-98331b156e8d service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:37.376884 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-14074b86-6398-4f35-b2b5-750e0009d987 req-589a7ce6-9937-4549-873c-98331b156e8d service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:37.388289 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-14074b86-6398-4f35-b2b5-750e0009d987 req-589a7ce6-9937-4549-873c-98331b156e8d service nova] Creating event network-changed:1fc13072-08e7-4bb8-8f8f-d55569372d0e for instance 9557131e-b3ea-4672-bdae-75a0c5a120e3 on hv-cinder-79987 Jul 28 05:37:37.393530 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-14074b86-6398-4f35-b2b5-750e0009d987 req-589a7ce6-9937-4549-873c-98331b156e8d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030758 Jul 28 05:37:37.394140 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 572/796] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:37:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:37:38.097569 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-91cc1862-0825-4729-a732-05250b8e7436 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:38.098982 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-91cc1862-0825-4729-a732-05250b8e7436 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:38.110488 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-91cc1862-0825-4729-a732-05250b8e7436 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:38.111172 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-91cc1862-0825-4729-a732-05250b8e7436 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:38.112124 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-91cc1862-0825-4729-a732-05250b8e7436 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:38.112704 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-91cc1862-0825-4729-a732-05250b8e7436 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:38.318328 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-91cc1862-0825-4729-a732-05250b8e7436 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:38.327934 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-91cc1862-0825-4729-a732-05250b8e7436 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:38.329576 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-91cc1862-0825-4729-a732-05250b8e7436 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:38.331003 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-91cc1862-0825-4729-a732-05250b8e7436 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 200 len: 1741 microversion: 2.20 time: 0.238108 Jul 28 05:37:38.331943 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 573/797] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:37:38 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 1741 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:37:39.355396 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-a4f39d4c-6a7a-470e-882f-c6b017e43037 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:39.356160 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-a4f39d4c-6a7a-470e-882f-c6b017e43037 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:39.363640 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a4f39d4c-6a7a-470e-882f-c6b017e43037 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:39.365660 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a4f39d4c-6a7a-470e-882f-c6b017e43037 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:39.365660 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a4f39d4c-6a7a-470e-882f-c6b017e43037 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:39.366026 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a4f39d4c-6a7a-470e-882f-c6b017e43037 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:39.506937 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-a4f39d4c-6a7a-470e-882f-c6b017e43037 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:39.515246 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-a4f39d4c-6a7a-470e-882f-c6b017e43037 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:39.516830 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-a4f39d4c-6a7a-470e-882f-c6b017e43037 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:39.518038 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-a4f39d4c-6a7a-470e-882f-c6b017e43037 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 200 len: 1741 microversion: 2.20 time: 0.166529 Jul 28 05:37:39.518792 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 574/798] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:37:39 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 1741 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:37:40.542563 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-7da4409d-a13d-4d18-b27d-d189687fd6d0 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:40.543282 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-7da4409d-a13d-4d18-b27d-d189687fd6d0 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:40.549922 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7da4409d-a13d-4d18-b27d-d189687fd6d0 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:40.550368 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7da4409d-a13d-4d18-b27d-d189687fd6d0 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:40.551136 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7da4409d-a13d-4d18-b27d-d189687fd6d0 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:40.551572 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7da4409d-a13d-4d18-b27d-d189687fd6d0 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:40.699647 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-7da4409d-a13d-4d18-b27d-d189687fd6d0 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:40.708488 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-7da4409d-a13d-4d18-b27d-d189687fd6d0 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:40.710312 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-7da4409d-a13d-4d18-b27d-d189687fd6d0 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:40.711749 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-7da4409d-a13d-4d18-b27d-d189687fd6d0 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 200 len: 1741 microversion: 2.20 time: 0.173065 Jul 28 05:37:40.712320 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 575/799] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:37:40 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 1741 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:37:41.735813 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-335efd08-aaf3-4ec4-8d06-33b558a6ac56 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:41.736483 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-335efd08-aaf3-4ec4-8d06-33b558a6ac56 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:41.743151 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-335efd08-aaf3-4ec4-8d06-33b558a6ac56 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:41.743612 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-335efd08-aaf3-4ec4-8d06-33b558a6ac56 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:41.744390 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-335efd08-aaf3-4ec4-8d06-33b558a6ac56 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:41.744875 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-335efd08-aaf3-4ec4-8d06-33b558a6ac56 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:41.879780 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-335efd08-aaf3-4ec4-8d06-33b558a6ac56 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:41.887556 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-335efd08-aaf3-4ec4-8d06-33b558a6ac56 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:41.889039 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-335efd08-aaf3-4ec4-8d06-33b558a6ac56 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:41.890930 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-335efd08-aaf3-4ec4-8d06-33b558a6ac56 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 200 len: 1723 microversion: 2.20 time: 0.159197 Jul 28 05:37:41.891581 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 576/800] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:37:41 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 05:37:42.915162 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-91a49294-e39a-48c6-8e92-830b93bf611c tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:42.916452 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-91a49294-e39a-48c6-8e92-830b93bf611c tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:42.923453 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-91a49294-e39a-48c6-8e92-830b93bf611c tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:42.923897 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-91a49294-e39a-48c6-8e92-830b93bf611c tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:42.924724 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-91a49294-e39a-48c6-8e92-830b93bf611c tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:42.925160 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-91a49294-e39a-48c6-8e92-830b93bf611c tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:43.057947 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-91a49294-e39a-48c6-8e92-830b93bf611c tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:43.066908 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-91a49294-e39a-48c6-8e92-830b93bf611c tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:43.068419 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-91a49294-e39a-48c6-8e92-830b93bf611c tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:43.069882 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-91a49294-e39a-48c6-8e92-830b93bf611c tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 200 len: 1723 microversion: 2.20 time: 0.158667 Jul 28 05:37:43.070450 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 577/801] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:37:42 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:37:44.096912 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-8a40a469-7c54-4837-bb00-9b82bad03fb6 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:44.099342 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-8a40a469-7c54-4837-bb00-9b82bad03fb6 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:44.103937 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8a40a469-7c54-4837-bb00-9b82bad03fb6 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:44.104388 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8a40a469-7c54-4837-bb00-9b82bad03fb6 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:44.105143 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8a40a469-7c54-4837-bb00-9b82bad03fb6 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:44.105601 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8a40a469-7c54-4837-bb00-9b82bad03fb6 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:44.237810 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-8a40a469-7c54-4837-bb00-9b82bad03fb6 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:44.245620 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-8a40a469-7c54-4837-bb00-9b82bad03fb6 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:44.247163 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-8a40a469-7c54-4837-bb00-9b82bad03fb6 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:44.248318 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-8a40a469-7c54-4837-bb00-9b82bad03fb6 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 200 len: 1723 microversion: 2.20 time: 0.155538 Jul 28 05:37:44.248927 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 578/802] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:37:44 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 05:37:44.435155 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-b935b4f5-1af9-4dde-b4ab-a48f3182e4b9 req-4abd1438-959b-410d-9772-2fbc3d68004e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54986322-1272-4f12-a108-b8675f3190a6", "name": "network-vif-unplugged", "status": "completed", "tag": "bb48c226-cd8a-426b-8392-6dcb3d411b85"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:37:44.445130 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-b935b4f5-1af9-4dde-b4ab-a48f3182e4b9 req-4abd1438-959b-410d-9772-2fbc3d68004e service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:44.445609 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-b935b4f5-1af9-4dde-b4ab-a48f3182e4b9 req-4abd1438-959b-410d-9772-2fbc3d68004e service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:44.456107 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-b935b4f5-1af9-4dde-b4ab-a48f3182e4b9 req-4abd1438-959b-410d-9772-2fbc3d68004e service nova] Creating event network-vif-unplugged:bb48c226-cd8a-426b-8392-6dcb3d411b85 for instance 54986322-1272-4f12-a108-b8675f3190a6 on hv-cinder-79987 Jul 28 05:37:44.463634 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-b935b4f5-1af9-4dde-b4ab-a48f3182e4b9 req-4abd1438-959b-410d-9772-2fbc3d68004e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029483 Jul 28 05:37:44.463634 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 579/803] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:37:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 05:37:45.272355 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-a806f5d8-e268-45fa-9a13-e4334b9b1101 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:45.273102 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-a806f5d8-e268-45fa-9a13-e4334b9b1101 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:45.279420 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a806f5d8-e268-45fa-9a13-e4334b9b1101 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:45.280603 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a806f5d8-e268-45fa-9a13-e4334b9b1101 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:45.281424 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a806f5d8-e268-45fa-9a13-e4334b9b1101 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:45.281915 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a806f5d8-e268-45fa-9a13-e4334b9b1101 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:45.412560 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-a806f5d8-e268-45fa-9a13-e4334b9b1101 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:45.420649 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-a806f5d8-e268-45fa-9a13-e4334b9b1101 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:45.422227 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-a806f5d8-e268-45fa-9a13-e4334b9b1101 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:45.426706 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-a806f5d8-e268-45fa-9a13-e4334b9b1101 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 200 len: 1723 microversion: 2.20 time: 0.156135 Jul 28 05:37:45.426706 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 580/804] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:37:45 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 05:37:46.446283 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-61f132eb-4ffe-46c3-bf79-064559cf03ba tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:46.446940 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-61f132eb-4ffe-46c3-bf79-064559cf03ba tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:46.454301 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-61f132eb-4ffe-46c3-bf79-064559cf03ba tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:46.454755 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-61f132eb-4ffe-46c3-bf79-064559cf03ba tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:46.455665 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-61f132eb-4ffe-46c3-bf79-064559cf03ba tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:46.456106 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-61f132eb-4ffe-46c3-bf79-064559cf03ba tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:46.592042 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-61f132eb-4ffe-46c3-bf79-064559cf03ba tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:46.600097 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-61f132eb-4ffe-46c3-bf79-064559cf03ba tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:46.601623 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-61f132eb-4ffe-46c3-bf79-064559cf03ba tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:46.602783 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-61f132eb-4ffe-46c3-bf79-064559cf03ba tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 200 len: 1723 microversion: 2.20 time: 0.160528 Jul 28 05:37:46.603350 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 581/805] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:37:46 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 05:37:47.627416 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-ba29918a-ff93-4cd9-96ff-a0fe49d03e99 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:47.628082 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-ba29918a-ff93-4cd9-96ff-a0fe49d03e99 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:47.634392 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ba29918a-ff93-4cd9-96ff-a0fe49d03e99 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:47.634829 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ba29918a-ff93-4cd9-96ff-a0fe49d03e99 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:47.635575 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ba29918a-ff93-4cd9-96ff-a0fe49d03e99 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:47.636001 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ba29918a-ff93-4cd9-96ff-a0fe49d03e99 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:47.765665 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-ba29918a-ff93-4cd9-96ff-a0fe49d03e99 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:47.772723 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-ba29918a-ff93-4cd9-96ff-a0fe49d03e99 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:47.774242 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-ba29918a-ff93-4cd9-96ff-a0fe49d03e99 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:47.775375 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-ba29918a-ff93-4cd9-96ff-a0fe49d03e99 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 200 len: 1666 microversion: 2.20 time: 0.152556 Jul 28 05:37:47.775935 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 582/806] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:37:47 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 1666 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:37:47.797506 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-c6526a74-bd0f-4b0c-b905-b381639e8371 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "727da02b-6a64-40b6-9b55-3acb77de407c"}} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:37:47.799768 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-c6526a74-bd0f-4b0c-b905-b381639e8371 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:47.805494 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c6526a74-bd0f-4b0c-b905-b381639e8371 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:47.805950 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c6526a74-bd0f-4b0c-b905-b381639e8371 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:47.806696 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c6526a74-bd0f-4b0c-b905-b381639e8371 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:47.807123 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c6526a74-bd0f-4b0c-b905-b381639e8371 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:48.407492 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:37:48.815488 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-c6526a74-bd0f-4b0c-b905-b381639e8371 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "POST /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.021713 Jul 28 05:37:48.816324 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 583/807] 10.222.0.33 () {62 vars in 1364 bytes} [Thu Jul 28 05:37:47 2022] POST /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6/os-volume_attachments => generated 188 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 05:37:48.946716 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-315d216d-7e5b-4e09-9ab4-4b617c29a69f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:48.947213 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-315d216d-7e5b-4e09-9ab4-4b617c29a69f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:48.954034 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-315d216d-7e5b-4e09-9ab4-4b617c29a69f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:48.954481 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-315d216d-7e5b-4e09-9ab4-4b617c29a69f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:48.955294 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-315d216d-7e5b-4e09-9ab4-4b617c29a69f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:48.955732 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-315d216d-7e5b-4e09-9ab4-4b617c29a69f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:49.546799 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-315d216d-7e5b-4e09-9ab4-4b617c29a69f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "DELETE /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6/os-volume_attachments/727da02b-6a64-40b6-9b55-3acb77de407c" status: 202 len: 0 microversion: 2.20 time: 0.604500 Jul 28 05:37:49.547412 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 584/808] 10.222.0.33 () {60 vars in 1457 bytes} [Thu Jul 28 05:37:48 2022] DELETE /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6/os-volume_attachments/727da02b-6a64-40b6-9b55-3acb77de407c => generated 0 bytes in 606 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 28 05:37:49.607371 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-62b26c4f-f3d9-4b5a-9541-1570f21392db tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:37:49.608461 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-62b26c4f-f3d9-4b5a-9541-1570f21392db tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:49.614480 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-62b26c4f-f3d9-4b5a-9541-1570f21392db tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:49.614929 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-62b26c4f-f3d9-4b5a-9541-1570f21392db tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:49.615680 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-62b26c4f-f3d9-4b5a-9541-1570f21392db tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:49.616116 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-62b26c4f-f3d9-4b5a-9541-1570f21392db tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:49.645996 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-62b26c4f-f3d9-4b5a-9541-1570f21392db tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124482) unshelve /opt/stack/nova/nova/compute/api.py:4532}} Jul 28 05:37:49.922721 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-62b26c4f-f3d9-4b5a-9541-1570f21392db tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "POST /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6/action" status: 202 len: 0 microversion: 2.20 time: 0.319058 Jul 28 05:37:49.923345 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 585/809] 10.222.0.33 () {62 vars in 1319 bytes} [Thu Jul 28 05:37:49 2022] POST /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6/action => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 28 05:37:49.931126 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-296873c9-682e-4116-8773-5d42b02d3e2f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:49.931720 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-296873c9-682e-4116-8773-5d42b02d3e2f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:49.937873 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-296873c9-682e-4116-8773-5d42b02d3e2f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:49.938313 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-296873c9-682e-4116-8773-5d42b02d3e2f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:49.939063 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-296873c9-682e-4116-8773-5d42b02d3e2f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:49.939497 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-296873c9-682e-4116-8773-5d42b02d3e2f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:50.070232 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-296873c9-682e-4116-8773-5d42b02d3e2f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:50.079359 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-296873c9-682e-4116-8773-5d42b02d3e2f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:50.080900 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-296873c9-682e-4116-8773-5d42b02d3e2f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:50.084915 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-296873c9-682e-4116-8773-5d42b02d3e2f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 200 len: 1674 microversion: 2.20 time: 0.154729 Jul 28 05:37:50.084915 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 586/810] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:37:49 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 05:37:51.104557 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-051c245e-17d2-4242-8029-e011b6855860 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:51.105195 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-051c245e-17d2-4242-8029-e011b6855860 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:51.112047 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-051c245e-17d2-4242-8029-e011b6855860 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:51.112490 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-051c245e-17d2-4242-8029-e011b6855860 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:51.113252 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-051c245e-17d2-4242-8029-e011b6855860 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:51.113708 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-051c245e-17d2-4242-8029-e011b6855860 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:51.246355 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-051c245e-17d2-4242-8029-e011b6855860 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:51.254530 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-051c245e-17d2-4242-8029-e011b6855860 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:51.256023 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-051c245e-17d2-4242-8029-e011b6855860 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:51.257175 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-051c245e-17d2-4242-8029-e011b6855860 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 200 len: 1674 microversion: 2.20 time: 0.156640 Jul 28 05:37:51.257783 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 587/811] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:37:51 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 05:37:52.281676 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-d6c8349a-1ffa-4566-be6f-fa509628cec4 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:52.282320 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-d6c8349a-1ffa-4566-be6f-fa509628cec4 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:52.288856 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d6c8349a-1ffa-4566-be6f-fa509628cec4 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:52.289306 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d6c8349a-1ffa-4566-be6f-fa509628cec4 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:52.290111 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d6c8349a-1ffa-4566-be6f-fa509628cec4 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:52.290546 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d6c8349a-1ffa-4566-be6f-fa509628cec4 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:52.425747 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-d6c8349a-1ffa-4566-be6f-fa509628cec4 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:52.432476 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-d6c8349a-1ffa-4566-be6f-fa509628cec4 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:52.433991 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-d6c8349a-1ffa-4566-be6f-fa509628cec4 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:52.435146 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-d6c8349a-1ffa-4566-be6f-fa509628cec4 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 200 len: 1732 microversion: 2.20 time: 0.157627 Jul 28 05:37:52.436349 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 588/812] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:37:52 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 05:37:53.458952 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-e24142f1-2bb3-4d33-97e9-31349650be4a tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:53.459641 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-e24142f1-2bb3-4d33-97e9-31349650be4a tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:53.466043 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e24142f1-2bb3-4d33-97e9-31349650be4a tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:53.466483 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e24142f1-2bb3-4d33-97e9-31349650be4a tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:53.467413 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e24142f1-2bb3-4d33-97e9-31349650be4a tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:53.467987 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e24142f1-2bb3-4d33-97e9-31349650be4a tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:53.725031 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-e24142f1-2bb3-4d33-97e9-31349650be4a tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:53.738890 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-e24142f1-2bb3-4d33-97e9-31349650be4a tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:53.745593 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-e24142f1-2bb3-4d33-97e9-31349650be4a tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:53.747088 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-e24142f1-2bb3-4d33-97e9-31349650be4a tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 200 len: 1732 microversion: 2.20 time: 0.291949 Jul 28 05:37:53.751435 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 589/813] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:37:53 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 1732 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 05:37:54.777148 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-a9e0087a-0cda-4af8-ad96-65ffd167bf27 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:54.777847 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-a9e0087a-0cda-4af8-ad96-65ffd167bf27 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:54.787089 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a9e0087a-0cda-4af8-ad96-65ffd167bf27 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:54.787681 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a9e0087a-0cda-4af8-ad96-65ffd167bf27 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:54.788951 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a9e0087a-0cda-4af8-ad96-65ffd167bf27 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:54.789513 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a9e0087a-0cda-4af8-ad96-65ffd167bf27 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:54.938682 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-a9e0087a-0cda-4af8-ad96-65ffd167bf27 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:54.946799 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-a9e0087a-0cda-4af8-ad96-65ffd167bf27 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:54.948310 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-a9e0087a-0cda-4af8-ad96-65ffd167bf27 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:54.949641 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-a9e0087a-0cda-4af8-ad96-65ffd167bf27 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 200 len: 1732 microversion: 2.20 time: 0.176119 Jul 28 05:37:54.950358 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 590/814] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:37:54 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 1732 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:37:55.972685 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-0416a3ec-3133-4159-aecc-2bee73c3c4cb tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:55.973306 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-0416a3ec-3133-4159-aecc-2bee73c3c4cb tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:55.980434 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-0416a3ec-3133-4159-aecc-2bee73c3c4cb tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:55.983710 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-0416a3ec-3133-4159-aecc-2bee73c3c4cb tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:55.983710 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-0416a3ec-3133-4159-aecc-2bee73c3c4cb tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:55.983710 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-0416a3ec-3133-4159-aecc-2bee73c3c4cb tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:56.118758 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-0416a3ec-3133-4159-aecc-2bee73c3c4cb tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:56.142364 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-0416a3ec-3133-4159-aecc-2bee73c3c4cb tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:56.144592 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-0416a3ec-3133-4159-aecc-2bee73c3c4cb tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:56.146102 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-0416a3ec-3133-4159-aecc-2bee73c3c4cb tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 200 len: 1732 microversion: 2.20 time: 0.177339 Jul 28 05:37:56.147007 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 591/815] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:37:55 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 1732 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:37:57.171574 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-4ade19c6-bcce-40db-9bf9-911161334cb8 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:57.172531 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-4ade19c6-bcce-40db-9bf9-911161334cb8 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:57.183201 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4ade19c6-bcce-40db-9bf9-911161334cb8 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:57.186199 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4ade19c6-bcce-40db-9bf9-911161334cb8 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:57.186199 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4ade19c6-bcce-40db-9bf9-911161334cb8 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:57.186199 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4ade19c6-bcce-40db-9bf9-911161334cb8 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:57.356286 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-4ade19c6-bcce-40db-9bf9-911161334cb8 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:57.364978 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-4ade19c6-bcce-40db-9bf9-911161334cb8 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:57.366726 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-4ade19c6-bcce-40db-9bf9-911161334cb8 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:57.367903 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-4ade19c6-bcce-40db-9bf9-911161334cb8 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 200 len: 1732 microversion: 2.20 time: 0.200620 Jul 28 05:37:57.384646 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 592/816] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:37:57 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 1732 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 05:37:58.397154 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-47d19ca7-195f-4de1-9517-c349ba90e213 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:58.398129 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-47d19ca7-195f-4de1-9517-c349ba90e213 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:58.405662 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-47d19ca7-195f-4de1-9517-c349ba90e213 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:58.406121 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-47d19ca7-195f-4de1-9517-c349ba90e213 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:58.406974 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-47d19ca7-195f-4de1-9517-c349ba90e213 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:58.407288 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-47d19ca7-195f-4de1-9517-c349ba90e213 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:58.619627 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-47d19ca7-195f-4de1-9517-c349ba90e213 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:58.629009 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-47d19ca7-195f-4de1-9517-c349ba90e213 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:58.630603 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-47d19ca7-195f-4de1-9517-c349ba90e213 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:58.631785 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-47d19ca7-195f-4de1-9517-c349ba90e213 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 200 len: 1732 microversion: 2.20 time: 0.239556 Jul 28 05:37:58.632532 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 593/817] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:37:58 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 1732 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:37:59.656716 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-d3f4acc3-7f1e-429e-b72c-dbedbc5ef22e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:37:59.657524 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-d3f4acc3-7f1e-429e-b72c-dbedbc5ef22e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:37:59.664458 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d3f4acc3-7f1e-429e-b72c-dbedbc5ef22e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:59.665033 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d3f4acc3-7f1e-429e-b72c-dbedbc5ef22e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:59.665943 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d3f4acc3-7f1e-429e-b72c-dbedbc5ef22e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:37:59.666480 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d3f4acc3-7f1e-429e-b72c-dbedbc5ef22e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:37:59.829162 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-d3f4acc3-7f1e-429e-b72c-dbedbc5ef22e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:59.841300 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-d3f4acc3-7f1e-429e-b72c-dbedbc5ef22e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:59.843633 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-d3f4acc3-7f1e-429e-b72c-dbedbc5ef22e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:37:59.844767 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-d3f4acc3-7f1e-429e-b72c-dbedbc5ef22e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 200 len: 1732 microversion: 2.20 time: 0.192044 Jul 28 05:37:59.845333 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 594/818] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:37:59 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 1732 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:38:00.011583 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-6041754c-d722-48f6-ae3c-21d1d9ddb566 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:38:00.014020 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-6041754c-d722-48f6-ae3c-21d1d9ddb566 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] [instance: 549e692f-7b6f-4ab0-987b-986a1934630e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:00.020780 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-6041754c-d722-48f6-ae3c-21d1d9ddb566 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:00.021354 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-6041754c-d722-48f6-ae3c-21d1d9ddb566 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:00.022258 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-6041754c-d722-48f6-ae3c-21d1d9ddb566 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:00.023072 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-6041754c-d722-48f6-ae3c-21d1d9ddb566 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:00.068324 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell1:UPDATE=8,nova_cell1:INSERT=4,nova_cell1:SELECT=88 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:00.312774 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-6041754c-d722-48f6-ae3c-21d1d9ddb566 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] 10.222.0.33 "POST /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e/action" status: 202 len: 0 microversion: 2.1 time: 0.304828 Jul 28 05:38:00.316707 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 595/819] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Jul 28 05:38:00 2022] POST /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e/action => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 05:38:00.322137 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-ba478f47-5e81-41e8-9a94-551acdf3a190 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:00.322822 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-ba478f47-5e81-41e8-9a94-551acdf3a190 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] [instance: 549e692f-7b6f-4ab0-987b-986a1934630e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:00.335067 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ba478f47-5e81-41e8-9a94-551acdf3a190 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:00.342996 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ba478f47-5e81-41e8-9a94-551acdf3a190 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:00.342996 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ba478f47-5e81-41e8-9a94-551acdf3a190 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:00.342996 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ba478f47-5e81-41e8-9a94-551acdf3a190 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:00.525837 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-ba478f47-5e81-41e8-9a94-551acdf3a190 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d859e797d874c948325f2ce0978edb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5989fabc615545eeb4ef987dea566175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:38:00.535343 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-ba478f47-5e81-41e8-9a94-551acdf3a190 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] 10.222.0.33 "GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e" status: 200 len: 1753 microversion: 2.1 time: 0.217452 Jul 28 05:38:00.536113 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 596/820] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:38:00 2022] GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e => generated 1753 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:38:00.869828 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-9104595e-3b76-4b58-b584-35ebbb6efb8f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:00.871454 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-9104595e-3b76-4b58-b584-35ebbb6efb8f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:00.883947 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9104595e-3b76-4b58-b584-35ebbb6efb8f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:00.884527 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9104595e-3b76-4b58-b584-35ebbb6efb8f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:00.888760 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9104595e-3b76-4b58-b584-35ebbb6efb8f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:00.888760 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9104595e-3b76-4b58-b584-35ebbb6efb8f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:01.051975 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-9104595e-3b76-4b58-b584-35ebbb6efb8f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:38:01.065166 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-9104595e-3b76-4b58-b584-35ebbb6efb8f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:38:01.072495 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-9104595e-3b76-4b58-b584-35ebbb6efb8f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:38:01.072495 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-9104595e-3b76-4b58-b584-35ebbb6efb8f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 200 len: 1732 microversion: 2.20 time: 0.202408 Jul 28 05:38:01.072495 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 597/821] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:38:00 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 1732 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 05:38:01.558063 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-3fba14dc-f68c-4aad-8031-d56ca727d4a0 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:01.558902 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-3fba14dc-f68c-4aad-8031-d56ca727d4a0 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] [instance: 549e692f-7b6f-4ab0-987b-986a1934630e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:01.561568 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:01.570492 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3fba14dc-f68c-4aad-8031-d56ca727d4a0 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:01.573662 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3fba14dc-f68c-4aad-8031-d56ca727d4a0 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:01.573662 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3fba14dc-f68c-4aad-8031-d56ca727d4a0 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:01.573662 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3fba14dc-f68c-4aad-8031-d56ca727d4a0 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:01.766322 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-3fba14dc-f68c-4aad-8031-d56ca727d4a0 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d859e797d874c948325f2ce0978edb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5989fabc615545eeb4ef987dea566175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:38:01.772444 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-3fba14dc-f68c-4aad-8031-d56ca727d4a0 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] 10.222.0.33 "GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e" status: 200 len: 1753 microversion: 2.1 time: 0.217726 Jul 28 05:38:01.772875 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 598/822] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:38:01 2022] GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e => generated 1753 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:38:02.092865 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-ae8e4ce5-d294-4e02-a02a-88e5506936bd tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:02.093580 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-ae8e4ce5-d294-4e02-a02a-88e5506936bd tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:02.100958 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ae8e4ce5-d294-4e02-a02a-88e5506936bd tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:02.101700 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ae8e4ce5-d294-4e02-a02a-88e5506936bd tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:02.102470 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ae8e4ce5-d294-4e02-a02a-88e5506936bd tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:02.102899 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ae8e4ce5-d294-4e02-a02a-88e5506936bd tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:02.261002 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-ae8e4ce5-d294-4e02-a02a-88e5506936bd tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:38:02.271789 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-ae8e4ce5-d294-4e02-a02a-88e5506936bd tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:38:02.273300 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-ae8e4ce5-d294-4e02-a02a-88e5506936bd tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:38:02.274512 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-ae8e4ce5-d294-4e02-a02a-88e5506936bd tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 200 len: 1732 microversion: 2.20 time: 0.185886 Jul 28 05:38:02.275075 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 599/823] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:38:02 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 1732 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 05:38:02.798240 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-bab79e5f-13c5-4bbf-aaf2-7b7ef0ac2117 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:02.799087 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-bab79e5f-13c5-4bbf-aaf2-7b7ef0ac2117 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] [instance: 549e692f-7b6f-4ab0-987b-986a1934630e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:02.806196 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-bab79e5f-13c5-4bbf-aaf2-7b7ef0ac2117 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:02.809648 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-bab79e5f-13c5-4bbf-aaf2-7b7ef0ac2117 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:02.809648 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-bab79e5f-13c5-4bbf-aaf2-7b7ef0ac2117 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:02.809648 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-bab79e5f-13c5-4bbf-aaf2-7b7ef0ac2117 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:02.973696 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-bab79e5f-13c5-4bbf-aaf2-7b7ef0ac2117 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d859e797d874c948325f2ce0978edb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5989fabc615545eeb4ef987dea566175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:38:02.984571 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-bab79e5f-13c5-4bbf-aaf2-7b7ef0ac2117 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] 10.222.0.33 "GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e" status: 200 len: 1753 microversion: 2.1 time: 0.190694 Jul 28 05:38:02.986165 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 600/824] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:38:02 2022] GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e => generated 1753 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:38:03.298308 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-58950019-2f33-4d44-8384-044976af37b7 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:03.299384 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-58950019-2f33-4d44-8384-044976af37b7 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:03.305780 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-58950019-2f33-4d44-8384-044976af37b7 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:03.306233 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-58950019-2f33-4d44-8384-044976af37b7 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:03.307342 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-58950019-2f33-4d44-8384-044976af37b7 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:03.307466 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-58950019-2f33-4d44-8384-044976af37b7 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:03.450639 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-58950019-2f33-4d44-8384-044976af37b7 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:38:03.461107 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-58950019-2f33-4d44-8384-044976af37b7 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:38:03.465716 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-58950019-2f33-4d44-8384-044976af37b7 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:38:03.466909 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-58950019-2f33-4d44-8384-044976af37b7 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 200 len: 1732 microversion: 2.20 time: 0.173096 Jul 28 05:38:03.467482 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 601/825] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:38:03 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 1732 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 05:38:04.008046 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-83c5d0b5-bede-4669-8e09-dc631c4413ba tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:04.008710 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-83c5d0b5-bede-4669-8e09-dc631c4413ba tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] [instance: 549e692f-7b6f-4ab0-987b-986a1934630e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:04.014679 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-83c5d0b5-bede-4669-8e09-dc631c4413ba tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:04.015123 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-83c5d0b5-bede-4669-8e09-dc631c4413ba tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:04.015879 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-83c5d0b5-bede-4669-8e09-dc631c4413ba tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:04.016327 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-83c5d0b5-bede-4669-8e09-dc631c4413ba tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:04.161926 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-83c5d0b5-bede-4669-8e09-dc631c4413ba tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d859e797d874c948325f2ce0978edb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5989fabc615545eeb4ef987dea566175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:38:04.169748 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-83c5d0b5-bede-4669-8e09-dc631c4413ba tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] 10.222.0.33 "GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e" status: 200 len: 1753 microversion: 2.1 time: 0.165448 Jul 28 05:38:04.170822 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 602/826] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:38:04 2022] GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:38:04.492140 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-9d21fa5b-a54a-43e6-8497-4fe27995e162 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:04.492772 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-9d21fa5b-a54a-43e6-8497-4fe27995e162 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:04.499191 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9d21fa5b-a54a-43e6-8497-4fe27995e162 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:04.499630 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9d21fa5b-a54a-43e6-8497-4fe27995e162 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:04.500385 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9d21fa5b-a54a-43e6-8497-4fe27995e162 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:04.500822 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9d21fa5b-a54a-43e6-8497-4fe27995e162 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:04.635233 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-9d21fa5b-a54a-43e6-8497-4fe27995e162 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:38:04.643854 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-9d21fa5b-a54a-43e6-8497-4fe27995e162 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:38:04.645667 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-9d21fa5b-a54a-43e6-8497-4fe27995e162 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:38:04.646838 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-9d21fa5b-a54a-43e6-8497-4fe27995e162 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 200 len: 1732 microversion: 2.20 time: 0.158620 Jul 28 05:38:04.647405 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 603/827] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:38:04 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 05:38:04.750874 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-2feb3898-e416-4dd1-a818-dfce05791e52 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:04.751297 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-2feb3898-e416-4dd1-a818-dfce05791e52 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: b4c59c70-b18e-4e7d-ad59-50b0e2e66041] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:04.757203 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2feb3898-e416-4dd1-a818-dfce05791e52 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:04.757693 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2feb3898-e416-4dd1-a818-dfce05791e52 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:04.758452 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2feb3898-e416-4dd1-a818-dfce05791e52 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:04.758886 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2feb3898-e416-4dd1-a818-dfce05791e52 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:04.783648 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-2feb3898-e416-4dd1-a818-dfce05791e52 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041/ips" status: 200 len: 145 microversion: 2.1 time: 0.036986 Jul 28 05:38:04.784237 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 604/828] 10.222.0.33 () {58 vars in 1248 bytes} [Thu Jul 28 05:38:04 2022] GET /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041/ips => generated 145 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 05:38:05.190807 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-95a15746-a723-4577-ae66-897682c69a95 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:05.191420 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-95a15746-a723-4577-ae66-897682c69a95 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] [instance: 549e692f-7b6f-4ab0-987b-986a1934630e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:05.197434 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-95a15746-a723-4577-ae66-897682c69a95 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:05.197912 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-95a15746-a723-4577-ae66-897682c69a95 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:05.210591 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-95a15746-a723-4577-ae66-897682c69a95 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:05.211043 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-95a15746-a723-4577-ae66-897682c69a95 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:05.363440 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-95a15746-a723-4577-ae66-897682c69a95 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d859e797d874c948325f2ce0978edb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5989fabc615545eeb4ef987dea566175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:38:05.371853 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-95a15746-a723-4577-ae66-897682c69a95 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] 10.222.0.33 "GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e" status: 200 len: 1753 microversion: 2.1 time: 0.184796 Jul 28 05:38:05.372621 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 605/829] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:38:05 2022] GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e => generated 1753 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:38:05.670910 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-781641e0-39bf-4bb6-87c5-e1f2ca273ae4 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:05.671601 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-781641e0-39bf-4bb6-87c5-e1f2ca273ae4 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:05.678051 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-781641e0-39bf-4bb6-87c5-e1f2ca273ae4 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:05.679905 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-781641e0-39bf-4bb6-87c5-e1f2ca273ae4 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:05.680702 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-781641e0-39bf-4bb6-87c5-e1f2ca273ae4 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:05.681134 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-781641e0-39bf-4bb6-87c5-e1f2ca273ae4 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:05.832245 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-781641e0-39bf-4bb6-87c5-e1f2ca273ae4 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:38:05.840313 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-781641e0-39bf-4bb6-87c5-e1f2ca273ae4 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:38:05.842099 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-781641e0-39bf-4bb6-87c5-e1f2ca273ae4 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:38:05.843301 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-781641e0-39bf-4bb6-87c5-e1f2ca273ae4 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 200 len: 1732 microversion: 2.20 time: 0.176692 Jul 28 05:38:05.843882 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 606/830] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:38:05 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 1732 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 05:38:06.394555 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-b1af7192-95d7-4887-9710-3445455c2583 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:06.395382 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-b1af7192-95d7-4887-9710-3445455c2583 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] [instance: 549e692f-7b6f-4ab0-987b-986a1934630e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:06.402179 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b1af7192-95d7-4887-9710-3445455c2583 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:06.403402 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b1af7192-95d7-4887-9710-3445455c2583 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:06.404585 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b1af7192-95d7-4887-9710-3445455c2583 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:06.405007 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b1af7192-95d7-4887-9710-3445455c2583 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:06.551392 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-b1af7192-95d7-4887-9710-3445455c2583 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d859e797d874c948325f2ce0978edb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5989fabc615545eeb4ef987dea566175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:38:06.559302 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-b1af7192-95d7-4887-9710-3445455c2583 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] 10.222.0.33 "GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e" status: 200 len: 1758 microversion: 2.1 time: 0.169189 Jul 28 05:38:06.559871 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 607/831] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:38:06 2022] GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:38:06.564537 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-d0c68c63-93e6-4417-a2d8-8a97154e1cbd tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "00de65d5-d160-4d73-b3d5-6b9ed7f5c0e8"}} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:38:06.566954 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-d0c68c63-93e6-4417-a2d8-8a97154e1cbd tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: b4c59c70-b18e-4e7d-ad59-50b0e2e66041] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:06.572654 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d0c68c63-93e6-4417-a2d8-8a97154e1cbd tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:06.573099 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d0c68c63-93e6-4417-a2d8-8a97154e1cbd tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:06.573899 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d0c68c63-93e6-4417-a2d8-8a97154e1cbd tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:06.574333 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d0c68c63-93e6-4417-a2d8-8a97154e1cbd tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:07.342218 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-d0c68c63-93e6-4417-a2d8-8a97154e1cbd tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "POST /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.781087 Jul 28 05:38:07.343058 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 608/832] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Jul 28 05:38:06 2022] POST /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041/os-volume_attachments => generated 194 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:38:07.348155 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-ebd7b99a-f830-4459-86d9-4329f25aa395 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:07.353611 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-ebd7b99a-f830-4459-86d9-4329f25aa395 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:07.355490 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ebd7b99a-f830-4459-86d9-4329f25aa395 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:07.355945 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ebd7b99a-f830-4459-86d9-4329f25aa395 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:07.356711 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ebd7b99a-f830-4459-86d9-4329f25aa395 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:07.357150 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ebd7b99a-f830-4459-86d9-4329f25aa395 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:07.494528 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-ebd7b99a-f830-4459-86d9-4329f25aa395 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:38:07.503311 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-ebd7b99a-f830-4459-86d9-4329f25aa395 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:38:07.504843 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-ebd7b99a-f830-4459-86d9-4329f25aa395 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:38:07.506053 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-ebd7b99a-f830-4459-86d9-4329f25aa395 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 200 len: 1732 microversion: 2.20 time: 0.161915 Jul 28 05:38:07.506811 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 609/833] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:38:07 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:38:07.581240 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-6e83e1eb-bcca-4984-8e06-dabfef63dd45 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:07.581880 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-6e83e1eb-bcca-4984-8e06-dabfef63dd45 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] [instance: 549e692f-7b6f-4ab0-987b-986a1934630e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:07.588067 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-6e83e1eb-bcca-4984-8e06-dabfef63dd45 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:07.588579 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-6e83e1eb-bcca-4984-8e06-dabfef63dd45 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:07.589431 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-6e83e1eb-bcca-4984-8e06-dabfef63dd45 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:07.589904 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-6e83e1eb-bcca-4984-8e06-dabfef63dd45 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:07.608944 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:07.739262 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-6e83e1eb-bcca-4984-8e06-dabfef63dd45 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d859e797d874c948325f2ce0978edb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5989fabc615545eeb4ef987dea566175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:38:07.747869 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-6e83e1eb-bcca-4984-8e06-dabfef63dd45 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] 10.222.0.33 "GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e" status: 200 len: 1758 microversion: 2.1 time: 0.171169 Jul 28 05:38:07.748432 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 610/834] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:38:07 2022] GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e => generated 1758 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:38:08.533018 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-91b15e93-bbc7-4f6a-962f-609d5bcddff4 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:08.534218 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-91b15e93-bbc7-4f6a-962f-609d5bcddff4 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:08.540961 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-91b15e93-bbc7-4f6a-962f-609d5bcddff4 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:08.541412 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-91b15e93-bbc7-4f6a-962f-609d5bcddff4 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:08.542873 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-91b15e93-bbc7-4f6a-962f-609d5bcddff4 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:08.543141 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-91b15e93-bbc7-4f6a-962f-609d5bcddff4 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:08.683652 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-91b15e93-bbc7-4f6a-962f-609d5bcddff4 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:38:08.692183 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-91b15e93-bbc7-4f6a-962f-609d5bcddff4 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:38:08.693718 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-91b15e93-bbc7-4f6a-962f-609d5bcddff4 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:38:08.694876 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-91b15e93-bbc7-4f6a-962f-609d5bcddff4 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 200 len: 1732 microversion: 2.20 time: 0.167765 Jul 28 05:38:08.695434 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 611/835] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:38:08 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 05:38:08.699707 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-daf97a03-59b6-4cdf-88c3-516de867e79d req-ca5bd7fc-67a9-4e3b-9da3-829783bf073d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54986322-1272-4f12-a108-b8675f3190a6", "name": "network-vif-plugged", "status": "completed", "tag": "bb48c226-cd8a-426b-8392-6dcb3d411b85"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:38:08.710162 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-daf97a03-59b6-4cdf-88c3-516de867e79d req-ca5bd7fc-67a9-4e3b-9da3-829783bf073d service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:08.711812 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-daf97a03-59b6-4cdf-88c3-516de867e79d req-ca5bd7fc-67a9-4e3b-9da3-829783bf073d service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:08.722047 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-daf97a03-59b6-4cdf-88c3-516de867e79d req-ca5bd7fc-67a9-4e3b-9da3-829783bf073d service nova] Creating event network-vif-plugged:bb48c226-cd8a-426b-8392-6dcb3d411b85 for instance 54986322-1272-4f12-a108-b8675f3190a6 on hv-cinder-79987 Jul 28 05:38:08.726774 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-daf97a03-59b6-4cdf-88c3-516de867e79d req-ca5bd7fc-67a9-4e3b-9da3-829783bf073d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030264 Jul 28 05:38:08.727930 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 612/836] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:38:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:38:08.770534 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-24fbe1b1-64e6-44a8-a5df-58fa5d737c0e tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:08.772119 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-24fbe1b1-64e6-44a8-a5df-58fa5d737c0e tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] [instance: 549e692f-7b6f-4ab0-987b-986a1934630e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:08.778700 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-24fbe1b1-64e6-44a8-a5df-58fa5d737c0e tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:08.779147 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-24fbe1b1-64e6-44a8-a5df-58fa5d737c0e tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:08.779900 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-24fbe1b1-64e6-44a8-a5df-58fa5d737c0e tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:08.780364 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-24fbe1b1-64e6-44a8-a5df-58fa5d737c0e tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:08.954598 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-24fbe1b1-64e6-44a8-a5df-58fa5d737c0e tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d859e797d874c948325f2ce0978edb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5989fabc615545eeb4ef987dea566175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:38:08.962766 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-24fbe1b1-64e6-44a8-a5df-58fa5d737c0e tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] 10.222.0.33 "GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e" status: 200 len: 1758 microversion: 2.1 time: 0.196753 Jul 28 05:38:08.964480 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 613/837] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:38:08 2022] GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e => generated 1758 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:38:09.719362 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-c2d7e005-db25-42f9-a905-493e8653c1f0 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:09.719983 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-c2d7e005-db25-42f9-a905-493e8653c1f0 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:09.726466 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c2d7e005-db25-42f9-a905-493e8653c1f0 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:09.726915 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c2d7e005-db25-42f9-a905-493e8653c1f0 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:09.727709 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c2d7e005-db25-42f9-a905-493e8653c1f0 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:09.728146 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c2d7e005-db25-42f9-a905-493e8653c1f0 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:09.867106 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-c2d7e005-db25-42f9-a905-493e8653c1f0 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:38:09.875172 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-c2d7e005-db25-42f9-a905-493e8653c1f0 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:38:09.876594 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-c2d7e005-db25-42f9-a905-493e8653c1f0 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:38:09.877777 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-c2d7e005-db25-42f9-a905-493e8653c1f0 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 200 len: 1732 microversion: 2.20 time: 0.162852 Jul 28 05:38:09.878406 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 614/838] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:38:09 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 05:38:09.984496 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-9d31bcc1-acff-457f-ba69-efd4465e549a tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:09.985180 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-9d31bcc1-acff-457f-ba69-efd4465e549a tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] [instance: 549e692f-7b6f-4ab0-987b-986a1934630e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:09.991076 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9d31bcc1-acff-457f-ba69-efd4465e549a tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:09.991525 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9d31bcc1-acff-457f-ba69-efd4465e549a tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:09.992280 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9d31bcc1-acff-457f-ba69-efd4465e549a tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:09.992712 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9d31bcc1-acff-457f-ba69-efd4465e549a tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:10.135484 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-9d31bcc1-acff-457f-ba69-efd4465e549a tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d859e797d874c948325f2ce0978edb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5989fabc615545eeb4ef987dea566175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:38:10.144678 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-9d31bcc1-acff-457f-ba69-efd4465e549a tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] 10.222.0.33 "GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e" status: 200 len: 1758 microversion: 2.1 time: 0.163722 Jul 28 05:38:10.145257 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 615/839] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:38:09 2022] GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e => generated 1758 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:38:10.901392 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-fff1f29a-b66f-48c8-8e52-02f1ad69d55a tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:10.902060 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-fff1f29a-b66f-48c8-8e52-02f1ad69d55a tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:10.908759 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-fff1f29a-b66f-48c8-8e52-02f1ad69d55a tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:10.913487 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-fff1f29a-b66f-48c8-8e52-02f1ad69d55a tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:10.913487 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-fff1f29a-b66f-48c8-8e52-02f1ad69d55a tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:10.913487 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-fff1f29a-b66f-48c8-8e52-02f1ad69d55a tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:11.053513 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-fff1f29a-b66f-48c8-8e52-02f1ad69d55a tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:38:11.062778 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-fff1f29a-b66f-48c8-8e52-02f1ad69d55a tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:38:11.064503 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-fff1f29a-b66f-48c8-8e52-02f1ad69d55a tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:38:11.065543 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-fff1f29a-b66f-48c8-8e52-02f1ad69d55a tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 200 len: 1732 microversion: 2.20 time: 0.167946 Jul 28 05:38:11.067349 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 616/840] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:38:10 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 1732 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:38:11.166895 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-f48b3fbb-821f-4222-ad03-01ef5dab9627 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:11.167587 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-f48b3fbb-821f-4222-ad03-01ef5dab9627 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] [instance: 549e692f-7b6f-4ab0-987b-986a1934630e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:11.174709 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f48b3fbb-821f-4222-ad03-01ef5dab9627 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:11.175381 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f48b3fbb-821f-4222-ad03-01ef5dab9627 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:11.176183 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f48b3fbb-821f-4222-ad03-01ef5dab9627 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:11.176622 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f48b3fbb-821f-4222-ad03-01ef5dab9627 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:11.333907 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-f48b3fbb-821f-4222-ad03-01ef5dab9627 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d859e797d874c948325f2ce0978edb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5989fabc615545eeb4ef987dea566175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:38:11.341857 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-f48b3fbb-821f-4222-ad03-01ef5dab9627 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] 10.222.0.33 "GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e" status: 200 len: 1758 microversion: 2.1 time: 0.179234 Jul 28 05:38:11.342427 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 617/841] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:38:11 2022] GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e => generated 1758 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:38:12.090199 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-417cbf31-6e25-47c2-9197-a6f3eae5d0de tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:12.091445 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-417cbf31-6e25-47c2-9197-a6f3eae5d0de tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:12.099421 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-417cbf31-6e25-47c2-9197-a6f3eae5d0de tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:12.099870 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-417cbf31-6e25-47c2-9197-a6f3eae5d0de tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:12.105655 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-417cbf31-6e25-47c2-9197-a6f3eae5d0de tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:12.105655 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-417cbf31-6e25-47c2-9197-a6f3eae5d0de tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:12.234798 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-417cbf31-6e25-47c2-9197-a6f3eae5d0de tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:38:12.242786 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-417cbf31-6e25-47c2-9197-a6f3eae5d0de tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:38:12.244317 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-417cbf31-6e25-47c2-9197-a6f3eae5d0de tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:38:12.245493 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-417cbf31-6e25-47c2-9197-a6f3eae5d0de tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 200 len: 1719 microversion: 2.20 time: 0.159125 Jul 28 05:38:12.246068 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 618/842] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:38:12 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 1719 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 05:38:12.362912 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-45cfc5cf-465c-4820-ad91-99104f24db2a tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:12.363459 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-45cfc5cf-465c-4820-ad91-99104f24db2a tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] [instance: 549e692f-7b6f-4ab0-987b-986a1934630e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:12.369807 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-45cfc5cf-465c-4820-ad91-99104f24db2a tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:12.370389 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-45cfc5cf-465c-4820-ad91-99104f24db2a tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:12.371150 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-45cfc5cf-465c-4820-ad91-99104f24db2a tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:12.371587 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-45cfc5cf-465c-4820-ad91-99104f24db2a tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:12.517320 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-45cfc5cf-465c-4820-ad91-99104f24db2a tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d859e797d874c948325f2ce0978edb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5989fabc615545eeb4ef987dea566175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:38:12.525517 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-45cfc5cf-465c-4820-ad91-99104f24db2a tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] 10.222.0.33 "GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e" status: 200 len: 1758 microversion: 2.1 time: 0.166723 Jul 28 05:38:12.526090 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 619/843] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:38:12 2022] GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e => generated 1758 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:38:13.547196 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-522bb8a4-3a9e-47bb-a9a9-8b0abff67042 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:13.547820 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-522bb8a4-3a9e-47bb-a9a9-8b0abff67042 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] [instance: 549e692f-7b6f-4ab0-987b-986a1934630e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:13.554541 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-522bb8a4-3a9e-47bb-a9a9-8b0abff67042 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:13.555111 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-522bb8a4-3a9e-47bb-a9a9-8b0abff67042 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:13.555764 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-522bb8a4-3a9e-47bb-a9a9-8b0abff67042 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:13.556210 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-522bb8a4-3a9e-47bb-a9a9-8b0abff67042 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:13.699564 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-522bb8a4-3a9e-47bb-a9a9-8b0abff67042 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d859e797d874c948325f2ce0978edb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5989fabc615545eeb4ef987dea566175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:38:13.707787 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-522bb8a4-3a9e-47bb-a9a9-8b0abff67042 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] 10.222.0.33 "GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e" status: 200 len: 1758 microversion: 2.1 time: 0.164772 Jul 28 05:38:13.708372 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 620/844] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:38:13 2022] GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:38:14.729013 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-05a9da83-e8c4-4779-89cb-b235cdf5b7c2 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:14.729717 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-05a9da83-e8c4-4779-89cb-b235cdf5b7c2 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] [instance: 549e692f-7b6f-4ab0-987b-986a1934630e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:14.736114 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-05a9da83-e8c4-4779-89cb-b235cdf5b7c2 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:14.736558 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-05a9da83-e8c4-4779-89cb-b235cdf5b7c2 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:14.737314 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-05a9da83-e8c4-4779-89cb-b235cdf5b7c2 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:14.737776 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-05a9da83-e8c4-4779-89cb-b235cdf5b7c2 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:14.901984 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-05a9da83-e8c4-4779-89cb-b235cdf5b7c2 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d859e797d874c948325f2ce0978edb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5989fabc615545eeb4ef987dea566175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:38:14.913336 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-05a9da83-e8c4-4779-89cb-b235cdf5b7c2 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] 10.222.0.33 "GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e" status: 200 len: 1758 microversion: 2.1 time: 0.186071 Jul 28 05:38:14.913336 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 621/845] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:38:14 2022] GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e => generated 1758 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:38:14.916952 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-e719eda3-7022-4da2-a391-f56d6ff9f47d tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:14.919544 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-e719eda3-7022-4da2-a391-f56d6ff9f47d tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: b4c59c70-b18e-4e7d-ad59-50b0e2e66041] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:14.925561 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e719eda3-7022-4da2-a391-f56d6ff9f47d tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:14.926007 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e719eda3-7022-4da2-a391-f56d6ff9f47d tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:14.926910 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e719eda3-7022-4da2-a391-f56d6ff9f47d tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:14.927342 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e719eda3-7022-4da2-a391-f56d6ff9f47d tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:14.957290 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-e719eda3-7022-4da2-a391-f56d6ff9f47d tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044363 Jul 28 05:38:14.961520 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 622/846] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Jul 28 05:38:14 2022] GET /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:38:14.967945 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-c26b09de-a87f-48de-92e1-924dec0618bb tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:14.968504 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-c26b09de-a87f-48de-92e1-924dec0618bb tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: b4c59c70-b18e-4e7d-ad59-50b0e2e66041] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:14.974290 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c26b09de-a87f-48de-92e1-924dec0618bb tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:14.974733 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c26b09de-a87f-48de-92e1-924dec0618bb tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:14.975473 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c26b09de-a87f-48de-92e1-924dec0618bb tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:14.975915 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c26b09de-a87f-48de-92e1-924dec0618bb tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:15.004533 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-c26b09de-a87f-48de-92e1-924dec0618bb tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041/os-volume_attachments/00de65d5-d160-4d73-b3d5-6b9ed7f5c0e8" status: 200 len: 194 microversion: 2.1 time: 0.040171 Jul 28 05:38:15.005031 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 623/847] 10.222.0.33 () {58 vars in 1413 bytes} [Thu Jul 28 05:38:14 2022] GET /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041/os-volume_attachments/00de65d5-d160-4d73-b3d5-6b9ed7f5c0e8 => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 05:38:15.932990 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-82c40d96-65f2-4bbe-8294-5c2e2fcb5904 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:15.933642 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-82c40d96-65f2-4bbe-8294-5c2e2fcb5904 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] [instance: 549e692f-7b6f-4ab0-987b-986a1934630e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:15.940470 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-82c40d96-65f2-4bbe-8294-5c2e2fcb5904 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:15.940917 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-82c40d96-65f2-4bbe-8294-5c2e2fcb5904 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:15.941814 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-82c40d96-65f2-4bbe-8294-5c2e2fcb5904 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:15.942252 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-82c40d96-65f2-4bbe-8294-5c2e2fcb5904 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:16.085958 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-82c40d96-65f2-4bbe-8294-5c2e2fcb5904 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d859e797d874c948325f2ce0978edb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5989fabc615545eeb4ef987dea566175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:38:16.095241 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-82c40d96-65f2-4bbe-8294-5c2e2fcb5904 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] 10.222.0.33 "GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e" status: 200 len: 1758 microversion: 2.1 time: 0.165960 Jul 28 05:38:16.099629 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 624/848] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:38:15 2022] GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e => generated 1758 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:38:16.681984 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-0012c834-7f91-42e3-a6b7-de2c3b157083 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "69b287e3-a2ed-43b8-aa5f-be7767431d3f"}} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:38:16.684387 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-0012c834-7f91-42e3-a6b7-de2c3b157083 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: b4c59c70-b18e-4e7d-ad59-50b0e2e66041] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:16.693396 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-0012c834-7f91-42e3-a6b7-de2c3b157083 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:16.694031 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-0012c834-7f91-42e3-a6b7-de2c3b157083 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:16.694800 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-0012c834-7f91-42e3-a6b7-de2c3b157083 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:16.695242 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-0012c834-7f91-42e3-a6b7-de2c3b157083 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:17.490776 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-0012c834-7f91-42e3-a6b7-de2c3b157083 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "POST /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.812459 Jul 28 05:38:17.491435 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 625/849] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Jul 28 05:38:16 2022] POST /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041/os-volume_attachments => generated 194 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 05:38:17.496479 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-4d5cce8b-a9b4-45f1-8635-f50637874456 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:17.497183 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-4d5cce8b-a9b4-45f1-8635-f50637874456 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] [instance: 549e692f-7b6f-4ab0-987b-986a1934630e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:17.503812 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4d5cce8b-a9b4-45f1-8635-f50637874456 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:17.504129 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4d5cce8b-a9b4-45f1-8635-f50637874456 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:17.504951 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4d5cce8b-a9b4-45f1-8635-f50637874456 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:17.505390 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4d5cce8b-a9b4-45f1-8635-f50637874456 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:17.525033 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:17.657303 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-4d5cce8b-a9b4-45f1-8635-f50637874456 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d859e797d874c948325f2ce0978edb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5989fabc615545eeb4ef987dea566175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:38:17.665048 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-4d5cce8b-a9b4-45f1-8635-f50637874456 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] 10.222.0.33 "GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e" status: 200 len: 1758 microversion: 2.1 time: 0.172585 Jul 28 05:38:17.665661 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 626/850] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:38:17 2022] GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e => generated 1758 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:38:18.686326 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-82916651-feff-4954-a532-5bba8c26f97b tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:18.686930 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-82916651-feff-4954-a532-5bba8c26f97b tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] [instance: 549e692f-7b6f-4ab0-987b-986a1934630e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:18.694573 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-82916651-feff-4954-a532-5bba8c26f97b tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:18.695018 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-82916651-feff-4954-a532-5bba8c26f97b tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:18.695767 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-82916651-feff-4954-a532-5bba8c26f97b tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:18.696197 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-82916651-feff-4954-a532-5bba8c26f97b tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:18.839439 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-82916651-feff-4954-a532-5bba8c26f97b tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d859e797d874c948325f2ce0978edb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5989fabc615545eeb4ef987dea566175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:38:18.847882 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-82916651-feff-4954-a532-5bba8c26f97b tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] 10.222.0.33 "GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e" status: 200 len: 1758 microversion: 2.1 time: 0.165499 Jul 28 05:38:18.848447 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 627/851] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:38:18 2022] GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e => generated 1758 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:38:19.870194 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-00482a27-14bc-4e80-b4e0-49e726aa55f4 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:19.870817 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-00482a27-14bc-4e80-b4e0-49e726aa55f4 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] [instance: 549e692f-7b6f-4ab0-987b-986a1934630e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:19.877893 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-00482a27-14bc-4e80-b4e0-49e726aa55f4 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:19.878390 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-00482a27-14bc-4e80-b4e0-49e726aa55f4 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:19.879169 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-00482a27-14bc-4e80-b4e0-49e726aa55f4 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:19.879603 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-00482a27-14bc-4e80-b4e0-49e726aa55f4 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:20.022484 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-00482a27-14bc-4e80-b4e0-49e726aa55f4 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d859e797d874c948325f2ce0978edb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5989fabc615545eeb4ef987dea566175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:38:20.030644 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-00482a27-14bc-4e80-b4e0-49e726aa55f4 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] 10.222.0.33 "GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e" status: 200 len: 1758 microversion: 2.1 time: 0.164371 Jul 28 05:38:20.031218 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 628/852] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:38:19 2022] GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:38:21.051901 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-06ee6538-ae1c-43de-831b-139af0d83d72 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:21.052554 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-06ee6538-ae1c-43de-831b-139af0d83d72 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] [instance: 549e692f-7b6f-4ab0-987b-986a1934630e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:21.059507 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-06ee6538-ae1c-43de-831b-139af0d83d72 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:21.059952 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-06ee6538-ae1c-43de-831b-139af0d83d72 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:21.060705 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-06ee6538-ae1c-43de-831b-139af0d83d72 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:21.061178 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-06ee6538-ae1c-43de-831b-139af0d83d72 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:21.207280 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-06ee6538-ae1c-43de-831b-139af0d83d72 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d859e797d874c948325f2ce0978edb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5989fabc615545eeb4ef987dea566175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:38:21.215295 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-06ee6538-ae1c-43de-831b-139af0d83d72 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] 10.222.0.33 "GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e" status: 200 len: 1758 microversion: 2.1 time: 0.167408 Jul 28 05:38:21.216044 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 629/853] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:38:21 2022] GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:38:21.369462 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-dbcbbcd5-09d0-4a21-ae0e-24cc96888f65 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:21.369908 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-dbcbbcd5-09d0-4a21-ae0e-24cc96888f65 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: 9557131e-b3ea-4672-bdae-75a0c5a120e3] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:21.375786 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-dbcbbcd5-09d0-4a21-ae0e-24cc96888f65 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:21.376225 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-dbcbbcd5-09d0-4a21-ae0e-24cc96888f65 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:21.376968 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-dbcbbcd5-09d0-4a21-ae0e-24cc96888f65 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:21.378054 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-dbcbbcd5-09d0-4a21-ae0e-24cc96888f65 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:21.401950 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-dbcbbcd5-09d0-4a21-ae0e-24cc96888f65 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3/ips" status: 200 len: 150 microversion: 2.1 time: 0.036274 Jul 28 05:38:21.403802 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 630/854] 10.222.0.33 () {58 vars in 1248 bytes} [Thu Jul 28 05:38:21 2022] GET /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 05:38:22.238104 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-bfbc1f96-6233-4332-b016-09f118507a29 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:22.238749 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-bfbc1f96-6233-4332-b016-09f118507a29 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] [instance: 549e692f-7b6f-4ab0-987b-986a1934630e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:22.245028 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-bfbc1f96-6233-4332-b016-09f118507a29 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:22.245475 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-bfbc1f96-6233-4332-b016-09f118507a29 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:22.246247 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-bfbc1f96-6233-4332-b016-09f118507a29 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:22.246676 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-bfbc1f96-6233-4332-b016-09f118507a29 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:22.386356 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-bfbc1f96-6233-4332-b016-09f118507a29 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d859e797d874c948325f2ce0978edb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5989fabc615545eeb4ef987dea566175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:38:22.394650 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-bfbc1f96-6233-4332-b016-09f118507a29 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] 10.222.0.33 "GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e" status: 200 len: 1761 microversion: 2.1 time: 0.160847 Jul 28 05:38:22.395222 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 631/855] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:38:22 2022] GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e => generated 1761 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:38:23.095140 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-e01d6086-32bb-4879-ba88-1252ccd939b3 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2d494713-6fb0-4d61-a12f-c1ef0b533e65"}} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:38:23.097645 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-e01d6086-32bb-4879-ba88-1252ccd939b3 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: 9557131e-b3ea-4672-bdae-75a0c5a120e3] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:23.103649 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e01d6086-32bb-4879-ba88-1252ccd939b3 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:23.104098 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e01d6086-32bb-4879-ba88-1252ccd939b3 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:23.104870 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e01d6086-32bb-4879-ba88-1252ccd939b3 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:23.105303 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e01d6086-32bb-4879-ba88-1252ccd939b3 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:23.919275 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-e01d6086-32bb-4879-ba88-1252ccd939b3 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "POST /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.827933 Jul 28 05:38:23.920207 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 632/856] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Jul 28 05:38:23 2022] POST /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3/os-volume_attachments => generated 194 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 05:38:25.022673 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-72e13e19-1129-4f0e-b947-cd3b16ee4ad5 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:25.025050 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-72e13e19-1129-4f0e-b947-cd3b16ee4ad5 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: b4c59c70-b18e-4e7d-ad59-50b0e2e66041] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:25.039078 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-72e13e19-1129-4f0e-b947-cd3b16ee4ad5 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:25.040351 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-72e13e19-1129-4f0e-b947-cd3b16ee4ad5 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:25.042219 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-72e13e19-1129-4f0e-b947-cd3b16ee4ad5 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:25.050230 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-72e13e19-1129-4f0e-b947-cd3b16ee4ad5 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:25.086715 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-72e13e19-1129-4f0e-b947-cd3b16ee4ad5 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.069417 Jul 28 05:38:25.089554 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 633/857] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Jul 28 05:38:25 2022] GET /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041/os-volume_attachments => generated 371 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 05:38:25.228795 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-7898d17e-fd45-4006-8cec-75483783f401 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:25.229203 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-7898d17e-fd45-4006-8cec-75483783f401 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: b4c59c70-b18e-4e7d-ad59-50b0e2e66041] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:25.235227 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7898d17e-fd45-4006-8cec-75483783f401 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:25.235670 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7898d17e-fd45-4006-8cec-75483783f401 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:25.236447 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7898d17e-fd45-4006-8cec-75483783f401 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:25.236889 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7898d17e-fd45-4006-8cec-75483783f401 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:25.312545 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-7898d17e-fd45-4006-8cec-75483783f401 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041/os-volume_attachments/00de65d5-d160-4d73-b3d5-6b9ed7f5c0e8" status: 200 len: 194 microversion: 2.1 time: 0.087731 Jul 28 05:38:25.313136 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 634/858] 10.222.0.33 () {58 vars in 1413 bytes} [Thu Jul 28 05:38:25 2022] GET /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041/os-volume_attachments/00de65d5-d160-4d73-b3d5-6b9ed7f5c0e8 => generated 194 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 05:38:25.339203 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-5d7069c2-190d-470a-aea3-4def46b3ddfc tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:25.339698 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-5d7069c2-190d-470a-aea3-4def46b3ddfc tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: b4c59c70-b18e-4e7d-ad59-50b0e2e66041] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:25.345812 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5d7069c2-190d-470a-aea3-4def46b3ddfc tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:25.346255 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5d7069c2-190d-470a-aea3-4def46b3ddfc tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:25.347062 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5d7069c2-190d-470a-aea3-4def46b3ddfc tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:25.347495 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5d7069c2-190d-470a-aea3-4def46b3ddfc tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:25.427730 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.objects.instance [None req-5d7069c2-190d-470a-aea3-4def46b3ddfc tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lazy-loading 'services' on Instance uuid b4c59c70-b18e-4e7d-ad59-50b0e2e66041 {{(pid=124482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 05:38:25.646435 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-5d7069c2-190d-470a-aea3-4def46b3ddfc tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041/os-volume_attachments/00de65d5-d160-4d73-b3d5-6b9ed7f5c0e8" status: 202 len: 0 microversion: 2.1 time: 0.310782 Jul 28 05:38:25.647022 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 635/859] 10.222.0.33 () {58 vars in 1416 bytes} [Thu Jul 28 05:38:25 2022] DELETE /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041/os-volume_attachments/00de65d5-d160-4d73-b3d5-6b9ed7f5c0e8 => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 05:38:32.638314 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-eab2042e-e455-41a6-b95c-dcac2e31b156 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:32.638936 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-eab2042e-e455-41a6-b95c-dcac2e31b156 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: 9557131e-b3ea-4672-bdae-75a0c5a120e3] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:32.646665 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-eab2042e-e455-41a6-b95c-dcac2e31b156 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:32.673707 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-eab2042e-e455-41a6-b95c-dcac2e31b156 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:32.673707 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-eab2042e-e455-41a6-b95c-dcac2e31b156 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:32.673707 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-eab2042e-e455-41a6-b95c-dcac2e31b156 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:32.740942 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.objects.instance [None req-eab2042e-e455-41a6-b95c-dcac2e31b156 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lazy-loading 'services' on Instance uuid 9557131e-b3ea-4672-bdae-75a0c5a120e3 {{(pid=124482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 05:38:33.009397 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-eab2042e-e455-41a6-b95c-dcac2e31b156 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3/os-volume_attachments/2d494713-6fb0-4d61-a12f-c1ef0b533e65" status: 202 len: 0 microversion: 2.1 time: 0.375917 Jul 28 05:38:33.010018 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 636/860] 10.222.0.33 () {58 vars in 1416 bytes} [Thu Jul 28 05:38:32 2022] DELETE /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3/os-volume_attachments/2d494713-6fb0-4d61-a12f-c1ef0b533e65 => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 05:38:33.020109 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-73dd12ea-ec2c-41db-9368-ed1285303bbc tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:33.021415 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-73dd12ea-ec2c-41db-9368-ed1285303bbc tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: 9557131e-b3ea-4672-bdae-75a0c5a120e3] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:33.023387 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_api:SELECT=78 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:33.028438 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-73dd12ea-ec2c-41db-9368-ed1285303bbc tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:33.037448 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-73dd12ea-ec2c-41db-9368-ed1285303bbc tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:33.037448 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-73dd12ea-ec2c-41db-9368-ed1285303bbc tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:33.037448 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-73dd12ea-ec2c-41db-9368-ed1285303bbc tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:33.058866 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-73dd12ea-ec2c-41db-9368-ed1285303bbc tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044203 Jul 28 05:38:33.059428 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 637/861] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Jul 28 05:38:33 2022] GET /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 05:38:34.072016 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-f6b195fa-1d0e-4bc1-b132-9e322bcfb5b2 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:34.074302 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-f6b195fa-1d0e-4bc1-b132-9e322bcfb5b2 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: 9557131e-b3ea-4672-bdae-75a0c5a120e3] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:34.081099 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f6b195fa-1d0e-4bc1-b132-9e322bcfb5b2 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:34.083267 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f6b195fa-1d0e-4bc1-b132-9e322bcfb5b2 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:34.083267 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f6b195fa-1d0e-4bc1-b132-9e322bcfb5b2 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:34.083267 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f6b195fa-1d0e-4bc1-b132-9e322bcfb5b2 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:34.114300 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-f6b195fa-1d0e-4bc1-b132-9e322bcfb5b2 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046191 Jul 28 05:38:34.114871 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 638/862] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Jul 28 05:38:34 2022] GET /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 05:38:34.247466 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-c01b79c6-4c9b-41ae-b90a-2d7c65de4cbb tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:34.247990 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-c01b79c6-4c9b-41ae-b90a-2d7c65de4cbb tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: b4c59c70-b18e-4e7d-ad59-50b0e2e66041] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:34.255122 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c01b79c6-4c9b-41ae-b90a-2d7c65de4cbb tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:34.255643 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c01b79c6-4c9b-41ae-b90a-2d7c65de4cbb tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:34.256460 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c01b79c6-4c9b-41ae-b90a-2d7c65de4cbb tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:34.256890 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c01b79c6-4c9b-41ae-b90a-2d7c65de4cbb tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:34.287509 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-c01b79c6-4c9b-41ae-b90a-2d7c65de4cbb tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041/os-volume_attachments/69b287e3-a2ed-43b8-aa5f-be7767431d3f" status: 200 len: 194 microversion: 2.1 time: 0.043923 Jul 28 05:38:34.288095 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 639/863] 10.222.0.33 () {58 vars in 1413 bytes} [Thu Jul 28 05:38:34 2022] GET /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041/os-volume_attachments/69b287e3-a2ed-43b8-aa5f-be7767431d3f => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 05:38:34.298237 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-63456389-8fd2-48ba-ae4b-d416511be88a tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:34.298725 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-63456389-8fd2-48ba-ae4b-d416511be88a tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: b4c59c70-b18e-4e7d-ad59-50b0e2e66041] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:34.305054 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-63456389-8fd2-48ba-ae4b-d416511be88a tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:34.305581 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-63456389-8fd2-48ba-ae4b-d416511be88a tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:34.306334 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-63456389-8fd2-48ba-ae4b-d416511be88a tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:34.306758 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-63456389-8fd2-48ba-ae4b-d416511be88a tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:34.380919 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:34.384387 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.objects.instance [None req-63456389-8fd2-48ba-ae4b-d416511be88a tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lazy-loading 'services' on Instance uuid b4c59c70-b18e-4e7d-ad59-50b0e2e66041 {{(pid=124482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 05:38:34.577780 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-63456389-8fd2-48ba-ae4b-d416511be88a tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041/os-volume_attachments/69b287e3-a2ed-43b8-aa5f-be7767431d3f" status: 202 len: 0 microversion: 2.1 time: 0.282893 Jul 28 05:38:34.578882 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 640/864] 10.222.0.33 () {58 vars in 1416 bytes} [Thu Jul 28 05:38:34 2022] DELETE /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041/os-volume_attachments/69b287e3-a2ed-43b8-aa5f-be7767431d3f => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 05:38:35.127676 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-150acac7-6791-4a53-9c70-94c1c61b10dd tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:35.130574 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-150acac7-6791-4a53-9c70-94c1c61b10dd tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: 9557131e-b3ea-4672-bdae-75a0c5a120e3] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:35.138537 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-150acac7-6791-4a53-9c70-94c1c61b10dd tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:35.138990 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-150acac7-6791-4a53-9c70-94c1c61b10dd tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:35.139787 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-150acac7-6791-4a53-9c70-94c1c61b10dd tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:35.140218 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-150acac7-6791-4a53-9c70-94c1c61b10dd tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:35.169680 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-150acac7-6791-4a53-9c70-94c1c61b10dd tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046661 Jul 28 05:38:35.170247 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 641/865] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Jul 28 05:38:35 2022] GET /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 05:38:35.236854 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-d1d7e9a2-2c39-40a4-a9f6-8d8306ed4d37 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:35.237375 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-d1d7e9a2-2c39-40a4-a9f6-8d8306ed4d37 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: 9557131e-b3ea-4672-bdae-75a0c5a120e3] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:35.244695 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d1d7e9a2-2c39-40a4-a9f6-8d8306ed4d37 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:35.245143 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d1d7e9a2-2c39-40a4-a9f6-8d8306ed4d37 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:35.245926 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d1d7e9a2-2c39-40a4-a9f6-8d8306ed4d37 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:35.246362 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d1d7e9a2-2c39-40a4-a9f6-8d8306ed4d37 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:35.272417 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-d1d7e9a2-2c39-40a4-a9f6-8d8306ed4d37 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: 9557131e-b3ea-4672-bdae-75a0c5a120e3] Going to try to terminate instance {{(pid=124482) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 05:38:35.572383 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-d1d7e9a2-2c39-40a4-a9f6-8d8306ed4d37 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3" status: 204 len: 0 microversion: 2.1 time: 0.339269 Jul 28 05:38:35.575086 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 642/866] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Jul 28 05:38:35 2022] DELETE /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 05:38:35.584190 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-cb8083ea-b3af-4980-bce4-25c021a01f38 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:35.584888 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-cb8083ea-b3af-4980-bce4-25c021a01f38 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: 9557131e-b3ea-4672-bdae-75a0c5a120e3] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:35.590837 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-cb8083ea-b3af-4980-bce4-25c021a01f38 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:35.591282 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-cb8083ea-b3af-4980-bce4-25c021a01f38 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:35.592052 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-cb8083ea-b3af-4980-bce4-25c021a01f38 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:35.592487 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-cb8083ea-b3af-4980-bce4-25c021a01f38 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:35.728982 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-cb8083ea-b3af-4980-bce4-25c021a01f38 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:38:35.736462 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-cb8083ea-b3af-4980-bce4-25c021a01f38 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3" status: 200 len: 1683 microversion: 2.1 time: 0.156892 Jul 28 05:38:35.737025 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 643/867] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:38:35 2022] GET /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:38:35.755208 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-25f8d115-cd9b-4213-944b-dd5da5f8680e tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:35.757460 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-25f8d115-cd9b-4213-944b-dd5da5f8680e tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: b4c59c70-b18e-4e7d-ad59-50b0e2e66041] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:35.763473 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-25f8d115-cd9b-4213-944b-dd5da5f8680e tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:35.767113 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-25f8d115-cd9b-4213-944b-dd5da5f8680e tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:35.767113 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-25f8d115-cd9b-4213-944b-dd5da5f8680e tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:35.767113 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-25f8d115-cd9b-4213-944b-dd5da5f8680e tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:35.793910 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-25f8d115-cd9b-4213-944b-dd5da5f8680e tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042694 Jul 28 05:38:35.798458 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 644/868] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Jul 28 05:38:35 2022] GET /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 05:38:36.763341 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-de6e0d92-eafa-4b16-8713-d6b2e1ae3634 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:36.764009 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-de6e0d92-eafa-4b16-8713-d6b2e1ae3634 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: 9557131e-b3ea-4672-bdae-75a0c5a120e3] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:36.770743 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-de6e0d92-eafa-4b16-8713-d6b2e1ae3634 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:36.773636 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-de6e0d92-eafa-4b16-8713-d6b2e1ae3634 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:36.773636 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-de6e0d92-eafa-4b16-8713-d6b2e1ae3634 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:36.773636 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-de6e0d92-eafa-4b16-8713-d6b2e1ae3634 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:36.908217 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-de6e0d92-eafa-4b16-8713-d6b2e1ae3634 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:38:36.916146 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-de6e0d92-eafa-4b16-8713-d6b2e1ae3634 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3" status: 200 len: 1683 microversion: 2.1 time: 0.156740 Jul 28 05:38:36.916760 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 645/869] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:38:36 2022] GET /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:38:36.926501 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-4d7e1655-2b5f-485f-9973-665b5dc7267a tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:36.926501 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-4d7e1655-2b5f-485f-9973-665b5dc7267a tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: b4c59c70-b18e-4e7d-ad59-50b0e2e66041] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:36.930523 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4d7e1655-2b5f-485f-9973-665b5dc7267a tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:36.930973 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4d7e1655-2b5f-485f-9973-665b5dc7267a tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:36.931769 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4d7e1655-2b5f-485f-9973-665b5dc7267a tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:36.932265 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4d7e1655-2b5f-485f-9973-665b5dc7267a tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:36.963520 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-4d7e1655-2b5f-485f-9973-665b5dc7267a tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045734 Jul 28 05:38:36.964079 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 646/870] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Jul 28 05:38:36 2022] GET /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:38:37.938554 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-556127ea-276d-4acc-90e2-48c2b5f9943a tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:37.939198 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-556127ea-276d-4acc-90e2-48c2b5f9943a tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: 9557131e-b3ea-4672-bdae-75a0c5a120e3] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:37.946139 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-556127ea-276d-4acc-90e2-48c2b5f9943a tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:37.946594 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-556127ea-276d-4acc-90e2-48c2b5f9943a tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:37.947319 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-556127ea-276d-4acc-90e2-48c2b5f9943a tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:37.947743 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-556127ea-276d-4acc-90e2-48c2b5f9943a tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:38.079511 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-556127ea-276d-4acc-90e2-48c2b5f9943a tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:38:38.087649 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-556127ea-276d-4acc-90e2-48c2b5f9943a tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3" status: 200 len: 1683 microversion: 2.1 time: 0.153019 Jul 28 05:38:38.088223 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 647/871] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:38:37 2022] GET /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:38:38.092979 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-52ccf94f-7b48-4ff4-9b74-9de7fa3d884b tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:38.095205 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-52ccf94f-7b48-4ff4-9b74-9de7fa3d884b tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: b4c59c70-b18e-4e7d-ad59-50b0e2e66041] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:38.101082 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-52ccf94f-7b48-4ff4-9b74-9de7fa3d884b tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:38.101609 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-52ccf94f-7b48-4ff4-9b74-9de7fa3d884b tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:38.102370 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-52ccf94f-7b48-4ff4-9b74-9de7fa3d884b tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:38.102805 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-52ccf94f-7b48-4ff4-9b74-9de7fa3d884b tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:38.131946 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-52ccf94f-7b48-4ff4-9b74-9de7fa3d884b tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042715 Jul 28 05:38:38.132505 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 648/872] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Jul 28 05:38:38 2022] GET /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 05:38:38.244680 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-c259d175-288c-43c0-ade1-e1429b8d00d1 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:38.246892 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-c259d175-288c-43c0-ade1-e1429b8d00d1 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: b4c59c70-b18e-4e7d-ad59-50b0e2e66041] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:38.252839 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c259d175-288c-43c0-ade1-e1429b8d00d1 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:38.253999 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c259d175-288c-43c0-ade1-e1429b8d00d1 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:38.254765 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c259d175-288c-43c0-ade1-e1429b8d00d1 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:38.255204 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c259d175-288c-43c0-ade1-e1429b8d00d1 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:38.283661 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-c259d175-288c-43c0-ade1-e1429b8d00d1 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042833 Jul 28 05:38:38.284216 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 649/873] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Jul 28 05:38:38 2022] GET /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 05:38:38.346014 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-c4e9ab58-a5d8-4fb5-920e-c402b6011c70 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:38.346512 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-c4e9ab58-a5d8-4fb5-920e-c402b6011c70 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: b4c59c70-b18e-4e7d-ad59-50b0e2e66041] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:38.352808 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c4e9ab58-a5d8-4fb5-920e-c402b6011c70 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:38.358726 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c4e9ab58-a5d8-4fb5-920e-c402b6011c70 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:38.358726 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c4e9ab58-a5d8-4fb5-920e-c402b6011c70 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:38.358726 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c4e9ab58-a5d8-4fb5-920e-c402b6011c70 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:38.379541 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-c4e9ab58-a5d8-4fb5-920e-c402b6011c70 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: b4c59c70-b18e-4e7d-ad59-50b0e2e66041] Going to try to terminate instance {{(pid=124482) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 05:38:38.672601 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-c4e9ab58-a5d8-4fb5-920e-c402b6011c70 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041" status: 204 len: 0 microversion: 2.1 time: 0.330157 Jul 28 05:38:38.673200 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 650/874] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Jul 28 05:38:38 2022] DELETE /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 05:38:38.682080 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-f2d590ca-a646-49df-8f71-3e88248b8e67 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:38.688379 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-f2d590ca-a646-49df-8f71-3e88248b8e67 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: b4c59c70-b18e-4e7d-ad59-50b0e2e66041] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:38.688545 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f2d590ca-a646-49df-8f71-3e88248b8e67 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:38.688994 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f2d590ca-a646-49df-8f71-3e88248b8e67 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:38.689786 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f2d590ca-a646-49df-8f71-3e88248b8e67 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:38.690223 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f2d590ca-a646-49df-8f71-3e88248b8e67 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:38.821195 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-f2d590ca-a646-49df-8f71-3e88248b8e67 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:38:38.828556 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-f2d590ca-a646-49df-8f71-3e88248b8e67 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041" status: 200 len: 1673 microversion: 2.1 time: 0.150409 Jul 28 05:38:38.829124 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 651/875] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:38:38 2022] GET /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041 => generated 1673 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:38:39.109086 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-3333c3df-223e-4f59-a4f4-f7642285dd3f tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:39.109773 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-3333c3df-223e-4f59-a4f4-f7642285dd3f tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: 9557131e-b3ea-4672-bdae-75a0c5a120e3] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:39.116327 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3333c3df-223e-4f59-a4f4-f7642285dd3f tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:39.116775 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3333c3df-223e-4f59-a4f4-f7642285dd3f tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:39.117536 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3333c3df-223e-4f59-a4f4-f7642285dd3f tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:39.117965 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3333c3df-223e-4f59-a4f4-f7642285dd3f tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:39.248217 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-3333c3df-223e-4f59-a4f4-f7642285dd3f tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:38:39.255896 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-3333c3df-223e-4f59-a4f4-f7642285dd3f tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3" status: 200 len: 1683 microversion: 2.1 time: 0.150681 Jul 28 05:38:39.256469 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 652/876] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:38:39 2022] GET /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3 => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:38:39.850136 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-dade6911-a8e2-43f6-8680-59b6f2238996 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:39.850842 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-dade6911-a8e2-43f6-8680-59b6f2238996 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: b4c59c70-b18e-4e7d-ad59-50b0e2e66041] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:39.856970 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-dade6911-a8e2-43f6-8680-59b6f2238996 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:39.867059 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-dade6911-a8e2-43f6-8680-59b6f2238996 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:39.867059 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-dade6911-a8e2-43f6-8680-59b6f2238996 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:39.867059 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-dade6911-a8e2-43f6-8680-59b6f2238996 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:39.876380 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:39.995248 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-dade6911-a8e2-43f6-8680-59b6f2238996 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:38:40.002873 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-dade6911-a8e2-43f6-8680-59b6f2238996 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041" status: 200 len: 1673 microversion: 2.1 time: 0.157339 Jul 28 05:38:40.003449 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 653/877] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:38:39 2022] GET /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041 => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:38:40.278328 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-04e9d797-4d10-4206-b78f-4ddb9662bc59 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:40.278980 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-04e9d797-4d10-4206-b78f-4ddb9662bc59 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: 9557131e-b3ea-4672-bdae-75a0c5a120e3] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:40.285798 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-04e9d797-4d10-4206-b78f-4ddb9662bc59 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:40.286237 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-04e9d797-4d10-4206-b78f-4ddb9662bc59 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:40.286982 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-04e9d797-4d10-4206-b78f-4ddb9662bc59 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:40.287407 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-04e9d797-4d10-4206-b78f-4ddb9662bc59 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:40.419080 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-04e9d797-4d10-4206-b78f-4ddb9662bc59 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:38:40.426634 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-04e9d797-4d10-4206-b78f-4ddb9662bc59 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3" status: 200 len: 1683 microversion: 2.1 time: 0.152467 Jul 28 05:38:40.427228 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 654/878] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:38:40 2022] GET /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:38:41.024072 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-e6502b1b-223c-45d3-98c2-63c7f4d0c11a tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:41.024686 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-e6502b1b-223c-45d3-98c2-63c7f4d0c11a tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: b4c59c70-b18e-4e7d-ad59-50b0e2e66041] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:41.030813 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e6502b1b-223c-45d3-98c2-63c7f4d0c11a tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:41.031270 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e6502b1b-223c-45d3-98c2-63c7f4d0c11a tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:41.032034 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e6502b1b-223c-45d3-98c2-63c7f4d0c11a tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:41.032612 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e6502b1b-223c-45d3-98c2-63c7f4d0c11a tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:41.165384 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-e6502b1b-223c-45d3-98c2-63c7f4d0c11a tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:38:41.173022 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-e6502b1b-223c-45d3-98c2-63c7f4d0c11a tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041" status: 200 len: 1673 microversion: 2.1 time: 0.152842 Jul 28 05:38:41.173590 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 655/879] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:38:41 2022] GET /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041 => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:38:41.449729 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-7d77cf22-e0f2-44ed-b34c-756ca7fb9662 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:41.450379 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-7d77cf22-e0f2-44ed-b34c-756ca7fb9662 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: 9557131e-b3ea-4672-bdae-75a0c5a120e3] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:41.456983 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7d77cf22-e0f2-44ed-b34c-756ca7fb9662 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:41.457430 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7d77cf22-e0f2-44ed-b34c-756ca7fb9662 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:41.458216 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7d77cf22-e0f2-44ed-b34c-756ca7fb9662 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:41.458653 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7d77cf22-e0f2-44ed-b34c-756ca7fb9662 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:41.588190 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-7d77cf22-e0f2-44ed-b34c-756ca7fb9662 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:38:41.595638 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-7d77cf22-e0f2-44ed-b34c-756ca7fb9662 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3" status: 200 len: 1683 microversion: 2.1 time: 0.149892 Jul 28 05:38:41.596203 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 656/880] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:38:41 2022] GET /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3 => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:38:42.195306 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-589e4f8a-edc1-4c52-b24c-e70515b7576f tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:42.195910 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-589e4f8a-edc1-4c52-b24c-e70515b7576f tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: b4c59c70-b18e-4e7d-ad59-50b0e2e66041] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:42.203053 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-589e4f8a-edc1-4c52-b24c-e70515b7576f tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:42.203053 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-589e4f8a-edc1-4c52-b24c-e70515b7576f tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:42.203291 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-589e4f8a-edc1-4c52-b24c-e70515b7576f tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:42.203620 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-589e4f8a-edc1-4c52-b24c-e70515b7576f tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:42.342329 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-589e4f8a-edc1-4c52-b24c-e70515b7576f tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:38:42.350024 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-589e4f8a-edc1-4c52-b24c-e70515b7576f tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041" status: 200 len: 1673 microversion: 2.1 time: 0.158615 Jul 28 05:38:42.350596 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 657/881] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:38:42 2022] GET /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041 => generated 1673 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:38:42.617859 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-846199b3-3e64-4b19-9b61-698c132af6e1 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:42.618519 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-846199b3-3e64-4b19-9b61-698c132af6e1 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: 9557131e-b3ea-4672-bdae-75a0c5a120e3] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:42.624881 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-846199b3-3e64-4b19-9b61-698c132af6e1 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:42.625332 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-846199b3-3e64-4b19-9b61-698c132af6e1 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:42.626371 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-846199b3-3e64-4b19-9b61-698c132af6e1 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:42.626815 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-846199b3-3e64-4b19-9b61-698c132af6e1 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:42.764860 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-846199b3-3e64-4b19-9b61-698c132af6e1 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:38:42.773684 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-846199b3-3e64-4b19-9b61-698c132af6e1 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3" status: 200 len: 1683 microversion: 2.1 time: 0.159715 Jul 28 05:38:42.774420 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 658/882] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:38:42 2022] GET /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3 => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:38:43.371585 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-63e78b1d-b0a9-4669-8612-42e14f7dd1dc tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:43.372298 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-63e78b1d-b0a9-4669-8612-42e14f7dd1dc tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: b4c59c70-b18e-4e7d-ad59-50b0e2e66041] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:43.379000 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-63e78b1d-b0a9-4669-8612-42e14f7dd1dc tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:43.379451 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-63e78b1d-b0a9-4669-8612-42e14f7dd1dc tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:43.380218 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-63e78b1d-b0a9-4669-8612-42e14f7dd1dc tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:43.380845 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-63e78b1d-b0a9-4669-8612-42e14f7dd1dc tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:43.447803 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-63e78b1d-b0a9-4669-8612-42e14f7dd1dc tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:38:43.458607 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-63e78b1d-b0a9-4669-8612-42e14f7dd1dc tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041" status: 200 len: 1605 microversion: 2.1 time: 0.090802 Jul 28 05:38:43.473259 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 659/883] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:38:43 2022] GET /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041 => generated 1605 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:38:43.621031 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-3ef088ac-7731-45bf-803a-ed7e41977087 req-89675b88-85f0-4c9d-b0f5-752b75e9bb13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9557131e-b3ea-4672-bdae-75a0c5a120e3", "name": "network-vif-deleted", "tag": "1fc13072-08e7-4bb8-8f8f-d55569372d0e"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:38:43.634860 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-3ef088ac-7731-45bf-803a-ed7e41977087 req-89675b88-85f0-4c9d-b0f5-752b75e9bb13 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:43.636171 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-3ef088ac-7731-45bf-803a-ed7e41977087 req-89675b88-85f0-4c9d-b0f5-752b75e9bb13 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:43.653121 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-3ef088ac-7731-45bf-803a-ed7e41977087 req-89675b88-85f0-4c9d-b0f5-752b75e9bb13 service nova] Creating event network-vif-deleted:1fc13072-08e7-4bb8-8f8f-d55569372d0e for instance 9557131e-b3ea-4672-bdae-75a0c5a120e3 on hv-cinder-79987 Jul 28 05:38:43.658805 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-3ef088ac-7731-45bf-803a-ed7e41977087 req-89675b88-85f0-4c9d-b0f5-752b75e9bb13 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047327 Jul 28 05:38:43.660754 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 660/884] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:38:43.835054 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-ad93e407-5049-4fdd-9bf2-0f958c69520b tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:43.837691 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-ad93e407-5049-4fdd-9bf2-0f958c69520b tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: 9557131e-b3ea-4672-bdae-75a0c5a120e3] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:43.849799 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ad93e407-5049-4fdd-9bf2-0f958c69520b tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:43.850749 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ad93e407-5049-4fdd-9bf2-0f958c69520b tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:43.851816 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ad93e407-5049-4fdd-9bf2-0f958c69520b tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:43.852442 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ad93e407-5049-4fdd-9bf2-0f958c69520b tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:43.955945 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-ad93e407-5049-4fdd-9bf2-0f958c69520b tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0002ebbc629b4dafb109dc94450fe1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0b7f7639504a25a73c94335d62b98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:38:43.964629 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-ad93e407-5049-4fdd-9bf2-0f958c69520b tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3" status: 200 len: 1327 microversion: 2.1 time: 0.171169 Jul 28 05:38:43.965324 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 661/885] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:38:43 2022] GET /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3 => generated 1327 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:38:44.479559 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-165f06fe-c618-4577-b1bb-3e216e435f9b tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:44.480342 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-165f06fe-c618-4577-b1bb-3e216e435f9b tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: b4c59c70-b18e-4e7d-ad59-50b0e2e66041] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:44.487088 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-165f06fe-c618-4577-b1bb-3e216e435f9b tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:44.488423 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-165f06fe-c618-4577-b1bb-3e216e435f9b tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:44.489719 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-165f06fe-c618-4577-b1bb-3e216e435f9b tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:44.490601 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-165f06fe-c618-4577-b1bb-3e216e435f9b tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:44.527042 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-165f06fe-c618-4577-b1bb-3e216e435f9b tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:44.527763 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-165f06fe-c618-4577-b1bb-3e216e435f9b tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:44.528227 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.objects.instance [None req-165f06fe-c618-4577-b1bb-3e216e435f9b tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lazy-loading 'fault' on Instance uuid b4c59c70-b18e-4e7d-ad59-50b0e2e66041 {{(pid=124482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 05:38:44.578252 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-165f06fe-c618-4577-b1bb-3e216e435f9b tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c43b517c8a464c93f0ce620826ad35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b96e460476f4bc9b35224e38b33f4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:38:44.588568 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-165f06fe-c618-4577-b1bb-3e216e435f9b tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041" status: 200 len: 1327 microversion: 2.1 time: 0.112855 Jul 28 05:38:44.589658 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 662/886] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:38:44 2022] GET /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041 => generated 1327 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:38:44.988364 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-e1a0d4ad-cc36-46fd-9aa5-b9fa909a0bea tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:44.992957 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-e1a0d4ad-cc36-46fd-9aa5-b9fa909a0bea tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: 9557131e-b3ea-4672-bdae-75a0c5a120e3] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:44.995878 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e1a0d4ad-cc36-46fd-9aa5-b9fa909a0bea tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:44.996324 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e1a0d4ad-cc36-46fd-9aa5-b9fa909a0bea tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:44.997087 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e1a0d4ad-cc36-46fd-9aa5-b9fa909a0bea tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:44.997636 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e1a0d4ad-cc36-46fd-9aa5-b9fa909a0bea tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:45.013789 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.wsgi [None req-e1a0d4ad-cc36-46fd-9aa5-b9fa909a0bea tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] HTTP exception thrown: Instance 9557131e-b3ea-4672-bdae-75a0c5a120e3 could not be found. Jul 28 05:38:45.015465 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-e1a0d4ad-cc36-46fd-9aa5-b9fa909a0bea tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Request method failure captured: Jul 28 05:38:45.015465 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: request: GET /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3 HTTP/1.1 Jul 28 05:38:45.015465 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept: application/json Jul 28 05:38:45.015465 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept-Encoding: identity Jul 28 05:38:45.015465 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Connection: close Jul 28 05:38:45.015465 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Length: 0 Jul 28 05:38:45.015465 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Type: application/json Jul 28 05:38:45.015465 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Host: 10.222.0.33 Jul 28 05:38:45.015465 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Openstack-System-Scope: None Jul 28 05:38:45.015465 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: User-Agent: python-urllib3/1.26.10 Jul 28 05:38:45.015465 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Auth-Token: gAAAAABi4h9D_G9i011T28yIc-ZNvejV_UpI0QoKlXE0FGZ91QFBkrT7qoFtXVHh-pu6aHMGmM56LTiBsS724USe_vuB1sVPXPQos6zopSWxHNIiTv0vnR9zJg55cl6dG7-t6mrt4b6a18Xfa5nEVVolwB-FkmudbFUJziZU1gufozNL3J-fAhg Jul 28 05:38:45.015465 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Id: None Jul 28 05:38:45.015465 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Name: None Jul 28 05:38:45.015465 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Identity-Status: Confirmed Jul 28 05:38:45.015465 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Is-Admin-Project: True Jul 28 05:38:45.015465 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Id: default Jul 28 05:38:45.015465 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Name: Default Jul 28 05:38:45.015465 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Id: ba0b7f7639504a25a73c94335d62b98f Jul 28 05:38:45.015465 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Name: tempest-AttachVolumeNegativeTest-1557602675 Jul 28 05:38:45.015465 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Role: member,reader Jul 28 05:38:45.015465 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Roles: member,reader Jul 28 05:38:45.016864 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ba0b7f7639504a25a73c94335d62b98f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ba0b7f7639504a25a73c94335d62b98f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ba0b7f7639504a25a73c94335d62b98f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ba0b7f7639504a25a73c94335d62b98f"}]}] Jul 28 05:38:45.016864 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant: tempest-AttachVolumeNegativeTest-1557602675 Jul 28 05:38:45.016864 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Id: ba0b7f7639504a25a73c94335d62b98f Jul 28 05:38:45.016864 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1557602675 Jul 28 05:38:45.016864 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User: tempest-AttachVolumeNegativeTest-1557602675-project Jul 28 05:38:45.016864 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Id: default Jul 28 05:38:45.016864 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Name: Default Jul 28 05:38:45.016864 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Id: 0002ebbc629b4dafb109dc94450fe1d8 Jul 28 05:38:45.016864 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Name: tempest-AttachVolumeNegativeTest-1557602675-project Jul 28 05:38:45.016864 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: method: > Jul 28 05:38:45.016864 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: exception: Instance 9557131e-b3ea-4672-bdae-75a0c5a120e3 could not be found. Jul 28 05:38:45.016864 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: action_args: {'id': '9557131e-b3ea-4672-bdae-75a0c5a120e3'} Jul 28 05:38:45.017761 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 05:38:45.017761 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:38:45.017761 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 05:38:45.017761 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 05:38:45.017761 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 05:38:45.017761 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 05:38:45.017761 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 05:38:45.017761 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 05:38:45.017761 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 05:38:45.017761 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 05:38:45.017761 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9557131e-b3ea-4672-bdae-75a0c5a120e3 could not be found. Jul 28 05:38:45.017761 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:45.017761 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:38:45.017761 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:45.017761 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:38:45.017761 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:38:45.017761 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:38:45.017761 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 05:38:45.017761 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 05:38:45.017761 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 05:38:45.019299 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:38:45.019299 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 05:38:45.019299 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 05:38:45.019299 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 05:38:45.019299 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 05:38:45.019299 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 05:38:45.019299 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 05:38:45.019299 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9557131e-b3ea-4672-bdae-75a0c5a120e3 could not be found. Jul 28 05:38:45.019299 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:45.019299 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:38:45.019299 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:45.019299 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:38:45.019299 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:38:45.019299 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:38:45.019299 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 05:38:45.019299 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 05:38:45.019299 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9557131e-b3ea-4672-bdae-75a0c5a120e3 could not be found. Jul 28 05:38:45.019299 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:45.022247 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-e1a0d4ad-cc36-46fd-9aa5-b9fa909a0bea tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Returning 404 to user: Instance 9557131e-b3ea-4672-bdae-75a0c5a120e3 could not be found. {{(pid=124482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 05:38:45.022247 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-e1a0d4ad-cc36-46fd-9aa5-b9fa909a0bea tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3" status: 404 len: 111 microversion: 2.1 time: 0.033161 Jul 28 05:38:45.022247 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 663/887] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:38:44 2022] GET /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 05:38:45.026707 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-43e7635f-cc2b-4ad8-9301-46f23bbcbfca tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '.version_select at 0x7f25e04bf310>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:45.131998 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-43e7635f-cc2b-4ad8-9301-46f23bbcbfca tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1611344322" status: 202 len: 0 microversion: 2.1 time: 0.109358 Jul 28 05:38:45.132585 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 664/888] 10.222.0.33 () {58 vars in 1221 bytes} [Thu Jul 28 05:38:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1611344322 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 05:38:45.610787 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-a9ecb17e-2efd-43fd-8150-9f200b7e7940 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:45.611604 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-a9ecb17e-2efd-43fd-8150-9f200b7e7940 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: b4c59c70-b18e-4e7d-ad59-50b0e2e66041] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:45.618473 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a9ecb17e-2efd-43fd-8150-9f200b7e7940 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:45.619125 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a9ecb17e-2efd-43fd-8150-9f200b7e7940 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:45.619927 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a9ecb17e-2efd-43fd-8150-9f200b7e7940 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:45.620449 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a9ecb17e-2efd-43fd-8150-9f200b7e7940 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:45.636613 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.wsgi [None req-a9ecb17e-2efd-43fd-8150-9f200b7e7940 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] HTTP exception thrown: Instance b4c59c70-b18e-4e7d-ad59-50b0e2e66041 could not be found. Jul 28 05:38:45.638399 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-a9ecb17e-2efd-43fd-8150-9f200b7e7940 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Request method failure captured: Jul 28 05:38:45.638399 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: request: GET /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041 HTTP/1.1 Jul 28 05:38:45.638399 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept: application/json Jul 28 05:38:45.638399 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept-Encoding: identity Jul 28 05:38:45.638399 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Connection: close Jul 28 05:38:45.638399 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Length: 0 Jul 28 05:38:45.638399 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Type: application/json Jul 28 05:38:45.638399 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Host: 10.222.0.33 Jul 28 05:38:45.638399 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Openstack-System-Scope: None Jul 28 05:38:45.638399 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: User-Agent: python-urllib3/1.26.10 Jul 28 05:38:45.638399 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Auth-Token: gAAAAABi4h83Xk7EohK6Ame0qqOjGVY0juEF6cixUUoN_nYeQOByClF9kUE2WC255jRgZjiBO-WvLks3jgM32fmGkUqUx4mTlP04nY78d2XJqH99wvWbHTy--wvnzUdM8tWiTYSpYV9O6enIYtVJrTR93S-aavCuDGofU0YWMspCK5-J78eoDSU Jul 28 05:38:45.638399 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Id: None Jul 28 05:38:45.638399 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Name: None Jul 28 05:38:45.638399 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Identity-Status: Confirmed Jul 28 05:38:45.638399 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Is-Admin-Project: True Jul 28 05:38:45.638399 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Id: default Jul 28 05:38:45.638399 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Name: Default Jul 28 05:38:45.638399 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Id: 7b96e460476f4bc9b35224e38b33f4c7 Jul 28 05:38:45.638399 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Name: tempest-AttachVolumeTestJSON-419609059 Jul 28 05:38:45.638399 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Role: member,reader Jul 28 05:38:45.638399 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Roles: member,reader Jul 28 05:38:45.639781 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7b96e460476f4bc9b35224e38b33f4c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7b96e460476f4bc9b35224e38b33f4c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7b96e460476f4bc9b35224e38b33f4c7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7b96e460476f4bc9b35224e38b33f4c7"}]}] Jul 28 05:38:45.639781 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant: tempest-AttachVolumeTestJSON-419609059 Jul 28 05:38:45.639781 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Id: 7b96e460476f4bc9b35224e38b33f4c7 Jul 28 05:38:45.639781 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Name: tempest-AttachVolumeTestJSON-419609059 Jul 28 05:38:45.639781 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User: tempest-AttachVolumeTestJSON-419609059-project Jul 28 05:38:45.639781 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Id: default Jul 28 05:38:45.639781 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Name: Default Jul 28 05:38:45.639781 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Id: b3c43b517c8a464c93f0ce620826ad35 Jul 28 05:38:45.639781 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Name: tempest-AttachVolumeTestJSON-419609059-project Jul 28 05:38:45.639781 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: method: > Jul 28 05:38:45.639781 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: exception: Instance b4c59c70-b18e-4e7d-ad59-50b0e2e66041 could not be found. Jul 28 05:38:45.639781 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: action_args: {'id': 'b4c59c70-b18e-4e7d-ad59-50b0e2e66041'} Jul 28 05:38:45.641622 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 05:38:45.641622 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:38:45.641622 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 05:38:45.641622 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 05:38:45.641622 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 05:38:45.641622 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 05:38:45.641622 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 05:38:45.641622 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 05:38:45.641622 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 05:38:45.641622 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 05:38:45.641622 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4c59c70-b18e-4e7d-ad59-50b0e2e66041 could not be found. Jul 28 05:38:45.641622 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:45.641622 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:38:45.641622 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:45.641622 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:38:45.641622 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:38:45.641622 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:38:45.641622 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 05:38:45.641622 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 05:38:45.641622 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 05:38:45.642946 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:38:45.642946 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 05:38:45.642946 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 05:38:45.642946 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 05:38:45.642946 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 05:38:45.642946 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 05:38:45.642946 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 05:38:45.642946 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4c59c70-b18e-4e7d-ad59-50b0e2e66041 could not be found. Jul 28 05:38:45.642946 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:45.642946 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:38:45.642946 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:45.642946 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:38:45.642946 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:38:45.642946 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:38:45.642946 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 05:38:45.642946 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 05:38:45.642946 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4c59c70-b18e-4e7d-ad59-50b0e2e66041 could not be found. Jul 28 05:38:45.642946 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:45.644707 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-a9ecb17e-2efd-43fd-8150-9f200b7e7940 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Returning 404 to user: Instance b4c59c70-b18e-4e7d-ad59-50b0e2e66041 could not be found. {{(pid=124482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 05:38:45.644707 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-a9ecb17e-2efd-43fd-8150-9f200b7e7940 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041" status: 404 len: 111 microversion: 2.1 time: 0.033172 Jul 28 05:38:45.644707 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 665/889] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:38:45 2022] GET /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 05:38:45.649902 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-19d87659-abba-4838-a14a-b15bf4240fd1 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '.version_select at 0x7f25e04bf310>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:45.731282 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-19d87659-abba-4838-a14a-b15bf4240fd1 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-257450573" status: 202 len: 0 microversion: 2.1 time: 0.085022 Jul 28 05:38:45.732303 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 666/890] 10.222.0.33 () {58 vars in 1218 bytes} [Thu Jul 28 05:38:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-257450573 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 05:38:45.740113 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-da7f3f31-128d-41c9-a8fb-47b8ffdca8ab req-74ce0e97-7ba7-481d-982b-ba7cbdacaaff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4c59c70-b18e-4e7d-ad59-50b0e2e66041", "name": "network-vif-deleted", "tag": "6358d70d-ca49-4c50-af18-16013f79bc5a"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:38:45.752752 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-da7f3f31-128d-41c9-a8fb-47b8ffdca8ab req-74ce0e97-7ba7-481d-982b-ba7cbdacaaff service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:45.754005 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-da7f3f31-128d-41c9-a8fb-47b8ffdca8ab req-74ce0e97-7ba7-481d-982b-ba7cbdacaaff service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:45.764967 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-da7f3f31-128d-41c9-a8fb-47b8ffdca8ab req-74ce0e97-7ba7-481d-982b-ba7cbdacaaff service nova] Creating event network-vif-deleted:6358d70d-ca49-4c50-af18-16013f79bc5a for instance b4c59c70-b18e-4e7d-ad59-50b0e2e66041 on hv-cinder-79987 Jul 28 05:38:45.770586 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-da7f3f31-128d-41c9-a8fb-47b8ffdca8ab req-74ce0e97-7ba7-481d-982b-ba7cbdacaaff service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037022 Jul 28 05:38:45.771331 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 667/891] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:38:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:38:47.265795 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-b72f5cc3-b7c3-422e-80af-a4c44b11764d tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:47.265795 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-b72f5cc3-b7c3-422e-80af-a4c44b11764d tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: 9557131e-b3ea-4672-bdae-75a0c5a120e3] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:47.271939 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b72f5cc3-b7c3-422e-80af-a4c44b11764d tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:47.272438 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b72f5cc3-b7c3-422e-80af-a4c44b11764d tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:47.273273 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b72f5cc3-b7c3-422e-80af-a4c44b11764d tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:47.273734 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b72f5cc3-b7c3-422e-80af-a4c44b11764d tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:47.287420 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.wsgi [None req-b72f5cc3-b7c3-422e-80af-a4c44b11764d tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] HTTP exception thrown: Instance 9557131e-b3ea-4672-bdae-75a0c5a120e3 could not be found. Jul 28 05:38:47.289132 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-b72f5cc3-b7c3-422e-80af-a4c44b11764d tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Request method failure captured: Jul 28 05:38:47.289132 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: request: DELETE /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3 HTTP/1.1 Jul 28 05:38:47.289132 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept: application/json Jul 28 05:38:47.289132 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept-Encoding: identity Jul 28 05:38:47.289132 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Connection: close Jul 28 05:38:47.289132 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Length: 0 Jul 28 05:38:47.289132 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Type: application/json Jul 28 05:38:47.289132 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Host: 10.222.0.33 Jul 28 05:38:47.289132 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Openstack-System-Scope: None Jul 28 05:38:47.289132 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: User-Agent: python-urllib3/1.26.10 Jul 28 05:38:47.289132 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Auth-Token: gAAAAABi4h9D_G9i011T28yIc-ZNvejV_UpI0QoKlXE0FGZ91QFBkrT7qoFtXVHh-pu6aHMGmM56LTiBsS724USe_vuB1sVPXPQos6zopSWxHNIiTv0vnR9zJg55cl6dG7-t6mrt4b6a18Xfa5nEVVolwB-FkmudbFUJziZU1gufozNL3J-fAhg Jul 28 05:38:47.289132 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Id: None Jul 28 05:38:47.289132 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Name: None Jul 28 05:38:47.289132 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Identity-Status: Confirmed Jul 28 05:38:47.289132 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Is-Admin-Project: True Jul 28 05:38:47.289132 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Id: default Jul 28 05:38:47.289132 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Name: Default Jul 28 05:38:47.289132 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Id: ba0b7f7639504a25a73c94335d62b98f Jul 28 05:38:47.289132 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Name: tempest-AttachVolumeNegativeTest-1557602675 Jul 28 05:38:47.289132 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Role: member,reader Jul 28 05:38:47.289132 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Roles: member,reader Jul 28 05:38:47.290696 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ba0b7f7639504a25a73c94335d62b98f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ba0b7f7639504a25a73c94335d62b98f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ba0b7f7639504a25a73c94335d62b98f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ba0b7f7639504a25a73c94335d62b98f"}]}] Jul 28 05:38:47.290696 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant: tempest-AttachVolumeNegativeTest-1557602675 Jul 28 05:38:47.290696 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Id: ba0b7f7639504a25a73c94335d62b98f Jul 28 05:38:47.290696 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1557602675 Jul 28 05:38:47.290696 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User: tempest-AttachVolumeNegativeTest-1557602675-project Jul 28 05:38:47.290696 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Id: default Jul 28 05:38:47.290696 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Name: Default Jul 28 05:38:47.290696 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Id: 0002ebbc629b4dafb109dc94450fe1d8 Jul 28 05:38:47.290696 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Name: tempest-AttachVolumeNegativeTest-1557602675-project Jul 28 05:38:47.290696 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: method: > Jul 28 05:38:47.290696 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: exception: Instance 9557131e-b3ea-4672-bdae-75a0c5a120e3 could not be found. Jul 28 05:38:47.290696 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: action_args: {'id': '9557131e-b3ea-4672-bdae-75a0c5a120e3'} Jul 28 05:38:47.291605 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 05:38:47.291605 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:38:47.291605 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 05:38:47.291605 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 05:38:47.291605 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 05:38:47.291605 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 05:38:47.291605 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 05:38:47.291605 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 05:38:47.291605 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 05:38:47.291605 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 05:38:47.291605 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9557131e-b3ea-4672-bdae-75a0c5a120e3 could not be found. Jul 28 05:38:47.291605 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:47.291605 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:38:47.291605 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:47.291605 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:38:47.291605 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:38:47.291605 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:38:47.291605 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 05:38:47.291605 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 05:38:47.291605 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 05:38:47.292985 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:38:47.292985 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 05:38:47.292985 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 05:38:47.292985 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 05:38:47.292985 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 05:38:47.292985 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 05:38:47.292985 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 05:38:47.292985 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 05:38:47.292985 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 05:38:47.292985 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9557131e-b3ea-4672-bdae-75a0c5a120e3 could not be found. Jul 28 05:38:47.292985 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:47.292985 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:38:47.292985 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:47.292985 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:38:47.292985 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:38:47.292985 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:38:47.292985 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 05:38:47.292985 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 05:38:47.292985 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9557131e-b3ea-4672-bdae-75a0c5a120e3 could not be found. Jul 28 05:38:47.292985 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:47.294388 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-b72f5cc3-b7c3-422e-80af-a4c44b11764d tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Returning 404 to user: Instance 9557131e-b3ea-4672-bdae-75a0c5a120e3 could not be found. {{(pid=124482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 05:38:47.294388 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-b72f5cc3-b7c3-422e-80af-a4c44b11764d tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3" status: 404 len: 111 microversion: 2.1 time: 0.030863 Jul 28 05:38:47.294388 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 668/892] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Jul 28 05:38:47 2022] DELETE /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 05:38:47.299576 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-3a20303f-bb59-4ca6-99ca-3d25d883ef8c tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:47.300853 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-3a20303f-bb59-4ca6-99ca-3d25d883ef8c tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: 9557131e-b3ea-4672-bdae-75a0c5a120e3] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:47.307134 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3a20303f-bb59-4ca6-99ca-3d25d883ef8c tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:47.307581 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3a20303f-bb59-4ca6-99ca-3d25d883ef8c tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:47.308378 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3a20303f-bb59-4ca6-99ca-3d25d883ef8c tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:47.308879 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3a20303f-bb59-4ca6-99ca-3d25d883ef8c tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:47.326089 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.wsgi [None req-3a20303f-bb59-4ca6-99ca-3d25d883ef8c tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] HTTP exception thrown: Instance 9557131e-b3ea-4672-bdae-75a0c5a120e3 could not be found. Jul 28 05:38:47.327825 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-3a20303f-bb59-4ca6-99ca-3d25d883ef8c tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Request method failure captured: Jul 28 05:38:47.327825 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: request: GET /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3 HTTP/1.1 Jul 28 05:38:47.327825 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept: application/json Jul 28 05:38:47.327825 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept-Encoding: identity Jul 28 05:38:47.327825 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Connection: close Jul 28 05:38:47.327825 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Length: 0 Jul 28 05:38:47.327825 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Type: application/json Jul 28 05:38:47.327825 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Host: 10.222.0.33 Jul 28 05:38:47.327825 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Openstack-System-Scope: None Jul 28 05:38:47.327825 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: User-Agent: python-urllib3/1.26.10 Jul 28 05:38:47.327825 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Auth-Token: gAAAAABi4h9D_G9i011T28yIc-ZNvejV_UpI0QoKlXE0FGZ91QFBkrT7qoFtXVHh-pu6aHMGmM56LTiBsS724USe_vuB1sVPXPQos6zopSWxHNIiTv0vnR9zJg55cl6dG7-t6mrt4b6a18Xfa5nEVVolwB-FkmudbFUJziZU1gufozNL3J-fAhg Jul 28 05:38:47.327825 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Id: None Jul 28 05:38:47.327825 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Name: None Jul 28 05:38:47.327825 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Identity-Status: Confirmed Jul 28 05:38:47.327825 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Is-Admin-Project: True Jul 28 05:38:47.327825 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Id: default Jul 28 05:38:47.327825 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Name: Default Jul 28 05:38:47.327825 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Id: ba0b7f7639504a25a73c94335d62b98f Jul 28 05:38:47.327825 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Name: tempest-AttachVolumeNegativeTest-1557602675 Jul 28 05:38:47.327825 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Role: member,reader Jul 28 05:38:47.327825 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Roles: member,reader Jul 28 05:38:47.329161 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ba0b7f7639504a25a73c94335d62b98f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ba0b7f7639504a25a73c94335d62b98f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ba0b7f7639504a25a73c94335d62b98f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ba0b7f7639504a25a73c94335d62b98f"}]}] Jul 28 05:38:47.329161 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant: tempest-AttachVolumeNegativeTest-1557602675 Jul 28 05:38:47.329161 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Id: ba0b7f7639504a25a73c94335d62b98f Jul 28 05:38:47.329161 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1557602675 Jul 28 05:38:47.329161 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User: tempest-AttachVolumeNegativeTest-1557602675-project Jul 28 05:38:47.329161 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Id: default Jul 28 05:38:47.329161 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Name: Default Jul 28 05:38:47.329161 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Id: 0002ebbc629b4dafb109dc94450fe1d8 Jul 28 05:38:47.329161 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Name: tempest-AttachVolumeNegativeTest-1557602675-project Jul 28 05:38:47.329161 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: method: > Jul 28 05:38:47.329161 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: exception: Instance 9557131e-b3ea-4672-bdae-75a0c5a120e3 could not be found. Jul 28 05:38:47.329161 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: action_args: {'id': '9557131e-b3ea-4672-bdae-75a0c5a120e3'} Jul 28 05:38:47.329906 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 05:38:47.329906 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:38:47.329906 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 05:38:47.329906 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 05:38:47.329906 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 05:38:47.329906 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 05:38:47.329906 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 05:38:47.329906 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 05:38:47.329906 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 05:38:47.329906 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 05:38:47.329906 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9557131e-b3ea-4672-bdae-75a0c5a120e3 could not be found. Jul 28 05:38:47.329906 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:47.329906 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:38:47.329906 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:47.329906 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:38:47.329906 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:38:47.329906 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:38:47.329906 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 05:38:47.329906 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 05:38:47.329906 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 05:38:47.331614 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:38:47.331614 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 05:38:47.331614 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 05:38:47.331614 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 05:38:47.331614 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 05:38:47.331614 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 05:38:47.331614 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 05:38:47.331614 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9557131e-b3ea-4672-bdae-75a0c5a120e3 could not be found. Jul 28 05:38:47.331614 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:47.331614 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:38:47.331614 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:47.331614 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:38:47.331614 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:38:47.331614 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:38:47.331614 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 05:38:47.331614 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 05:38:47.331614 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9557131e-b3ea-4672-bdae-75a0c5a120e3 could not be found. Jul 28 05:38:47.331614 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:47.333680 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-3a20303f-bb59-4ca6-99ca-3d25d883ef8c tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Returning 404 to user: Instance 9557131e-b3ea-4672-bdae-75a0c5a120e3 could not be found. {{(pid=124482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 05:38:47.333680 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-3a20303f-bb59-4ca6-99ca-3d25d883ef8c tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3" status: 404 len: 111 microversion: 2.1 time: 0.033956 Jul 28 05:38:47.333680 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 669/893] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:38:47 2022] GET /compute/v2.1/servers/9557131e-b3ea-4672-bdae-75a0c5a120e3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 05:38:48.666937 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-2de4f7ef-554f-4d62-b524-6d0083cd993d tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:48.667561 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-2de4f7ef-554f-4d62-b524-6d0083cd993d tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: b9162e60-7996-4d4d-964f-6844383357b6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:48.677233 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2de4f7ef-554f-4d62-b524-6d0083cd993d tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:48.678086 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2de4f7ef-554f-4d62-b524-6d0083cd993d tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:48.678957 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2de4f7ef-554f-4d62-b524-6d0083cd993d tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:48.679394 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2de4f7ef-554f-4d62-b524-6d0083cd993d tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:48.695938 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.wsgi [None req-2de4f7ef-554f-4d62-b524-6d0083cd993d tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] HTTP exception thrown: Instance b9162e60-7996-4d4d-964f-6844383357b6 could not be found. Jul 28 05:38:48.697455 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-2de4f7ef-554f-4d62-b524-6d0083cd993d tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Request method failure captured: Jul 28 05:38:48.697455 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: request: DELETE /compute/v2.1/servers/b9162e60-7996-4d4d-964f-6844383357b6 HTTP/1.1 Jul 28 05:38:48.697455 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept: application/json Jul 28 05:38:48.697455 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept-Encoding: identity Jul 28 05:38:48.697455 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Connection: close Jul 28 05:38:48.697455 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Length: 0 Jul 28 05:38:48.697455 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Type: application/json Jul 28 05:38:48.697455 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Host: 10.222.0.33 Jul 28 05:38:48.697455 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Openstack-System-Scope: None Jul 28 05:38:48.697455 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: User-Agent: python-urllib3/1.26.10 Jul 28 05:38:48.697455 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Auth-Token: gAAAAABi4h9D_G9i011T28yIc-ZNvejV_UpI0QoKlXE0FGZ91QFBkrT7qoFtXVHh-pu6aHMGmM56LTiBsS724USe_vuB1sVPXPQos6zopSWxHNIiTv0vnR9zJg55cl6dG7-t6mrt4b6a18Xfa5nEVVolwB-FkmudbFUJziZU1gufozNL3J-fAhg Jul 28 05:38:48.697455 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Id: None Jul 28 05:38:48.697455 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Name: None Jul 28 05:38:48.697455 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Identity-Status: Confirmed Jul 28 05:38:48.697455 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Is-Admin-Project: True Jul 28 05:38:48.697455 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Id: default Jul 28 05:38:48.697455 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Name: Default Jul 28 05:38:48.697455 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Id: ba0b7f7639504a25a73c94335d62b98f Jul 28 05:38:48.697455 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Name: tempest-AttachVolumeNegativeTest-1557602675 Jul 28 05:38:48.697455 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Role: member,reader Jul 28 05:38:48.697455 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Roles: member,reader Jul 28 05:38:48.699062 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ba0b7f7639504a25a73c94335d62b98f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ba0b7f7639504a25a73c94335d62b98f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ba0b7f7639504a25a73c94335d62b98f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ba0b7f7639504a25a73c94335d62b98f"}]}] Jul 28 05:38:48.699062 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant: tempest-AttachVolumeNegativeTest-1557602675 Jul 28 05:38:48.699062 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Id: ba0b7f7639504a25a73c94335d62b98f Jul 28 05:38:48.699062 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1557602675 Jul 28 05:38:48.699062 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User: tempest-AttachVolumeNegativeTest-1557602675-project Jul 28 05:38:48.699062 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Id: default Jul 28 05:38:48.699062 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Name: Default Jul 28 05:38:48.699062 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Id: 0002ebbc629b4dafb109dc94450fe1d8 Jul 28 05:38:48.699062 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Name: tempest-AttachVolumeNegativeTest-1557602675-project Jul 28 05:38:48.699062 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: method: > Jul 28 05:38:48.699062 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: exception: Instance b9162e60-7996-4d4d-964f-6844383357b6 could not be found. Jul 28 05:38:48.699062 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: action_args: {'id': 'b9162e60-7996-4d4d-964f-6844383357b6'} Jul 28 05:38:48.699986 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 05:38:48.699986 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:38:48.699986 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 05:38:48.699986 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 05:38:48.699986 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 05:38:48.699986 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 05:38:48.699986 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 05:38:48.699986 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 05:38:48.699986 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 05:38:48.699986 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 05:38:48.699986 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9162e60-7996-4d4d-964f-6844383357b6 could not be found. Jul 28 05:38:48.699986 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:48.699986 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:38:48.699986 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:48.699986 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:38:48.699986 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:38:48.699986 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:38:48.699986 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 05:38:48.699986 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 05:38:48.699986 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 05:38:48.701398 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:38:48.701398 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 05:38:48.701398 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 05:38:48.701398 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 05:38:48.701398 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 05:38:48.701398 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 05:38:48.701398 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 05:38:48.701398 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 05:38:48.701398 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 05:38:48.701398 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9162e60-7996-4d4d-964f-6844383357b6 could not be found. Jul 28 05:38:48.701398 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:48.701398 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:38:48.701398 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:48.701398 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:38:48.701398 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:38:48.701398 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:38:48.701398 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 05:38:48.701398 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 05:38:48.701398 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9162e60-7996-4d4d-964f-6844383357b6 could not be found. Jul 28 05:38:48.701398 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:48.708705 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-2de4f7ef-554f-4d62-b524-6d0083cd993d tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Returning 404 to user: Instance b9162e60-7996-4d4d-964f-6844383357b6 could not be found. {{(pid=124482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 05:38:48.708705 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-2de4f7ef-554f-4d62-b524-6d0083cd993d tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b9162e60-7996-4d4d-964f-6844383357b6" status: 404 len: 111 microversion: 2.1 time: 0.035954 Jul 28 05:38:48.708705 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 670/894] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Jul 28 05:38:48 2022] DELETE /compute/v2.1/servers/b9162e60-7996-4d4d-964f-6844383357b6 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 05:38:48.708705 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-131c2c7a-8504-4754-a476-ed29c969d10c tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:48.708705 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-131c2c7a-8504-4754-a476-ed29c969d10c tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: b9162e60-7996-4d4d-964f-6844383357b6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:48.714584 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-131c2c7a-8504-4754-a476-ed29c969d10c tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:48.715018 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-131c2c7a-8504-4754-a476-ed29c969d10c tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:48.715760 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-131c2c7a-8504-4754-a476-ed29c969d10c tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:48.716185 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-131c2c7a-8504-4754-a476-ed29c969d10c tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:48.729582 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.wsgi [None req-131c2c7a-8504-4754-a476-ed29c969d10c tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] HTTP exception thrown: Instance b9162e60-7996-4d4d-964f-6844383357b6 could not be found. Jul 28 05:38:48.731062 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-131c2c7a-8504-4754-a476-ed29c969d10c tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Request method failure captured: Jul 28 05:38:48.731062 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: request: GET /compute/v2.1/servers/b9162e60-7996-4d4d-964f-6844383357b6 HTTP/1.1 Jul 28 05:38:48.731062 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept: application/json Jul 28 05:38:48.731062 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept-Encoding: identity Jul 28 05:38:48.731062 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Connection: close Jul 28 05:38:48.731062 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Length: 0 Jul 28 05:38:48.731062 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Type: application/json Jul 28 05:38:48.731062 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Host: 10.222.0.33 Jul 28 05:38:48.731062 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Openstack-System-Scope: None Jul 28 05:38:48.731062 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: User-Agent: python-urllib3/1.26.10 Jul 28 05:38:48.731062 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Auth-Token: gAAAAABi4h9D_G9i011T28yIc-ZNvejV_UpI0QoKlXE0FGZ91QFBkrT7qoFtXVHh-pu6aHMGmM56LTiBsS724USe_vuB1sVPXPQos6zopSWxHNIiTv0vnR9zJg55cl6dG7-t6mrt4b6a18Xfa5nEVVolwB-FkmudbFUJziZU1gufozNL3J-fAhg Jul 28 05:38:48.731062 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Id: None Jul 28 05:38:48.731062 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Name: None Jul 28 05:38:48.731062 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Identity-Status: Confirmed Jul 28 05:38:48.731062 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Is-Admin-Project: True Jul 28 05:38:48.731062 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Id: default Jul 28 05:38:48.731062 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Name: Default Jul 28 05:38:48.731062 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Id: ba0b7f7639504a25a73c94335d62b98f Jul 28 05:38:48.731062 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Name: tempest-AttachVolumeNegativeTest-1557602675 Jul 28 05:38:48.731062 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Role: member,reader Jul 28 05:38:48.731062 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Roles: member,reader Jul 28 05:38:48.732569 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ba0b7f7639504a25a73c94335d62b98f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ba0b7f7639504a25a73c94335d62b98f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ba0b7f7639504a25a73c94335d62b98f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ba0b7f7639504a25a73c94335d62b98f"}]}] Jul 28 05:38:48.732569 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant: tempest-AttachVolumeNegativeTest-1557602675 Jul 28 05:38:48.732569 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Id: ba0b7f7639504a25a73c94335d62b98f Jul 28 05:38:48.732569 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1557602675 Jul 28 05:38:48.732569 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User: tempest-AttachVolumeNegativeTest-1557602675-project Jul 28 05:38:48.732569 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Id: default Jul 28 05:38:48.732569 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Name: Default Jul 28 05:38:48.732569 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Id: 0002ebbc629b4dafb109dc94450fe1d8 Jul 28 05:38:48.732569 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Name: tempest-AttachVolumeNegativeTest-1557602675-project Jul 28 05:38:48.732569 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: method: > Jul 28 05:38:48.732569 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: exception: Instance b9162e60-7996-4d4d-964f-6844383357b6 could not be found. Jul 28 05:38:48.732569 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: action_args: {'id': 'b9162e60-7996-4d4d-964f-6844383357b6'} Jul 28 05:38:48.733419 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 05:38:48.733419 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:38:48.733419 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 05:38:48.733419 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 05:38:48.733419 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 05:38:48.733419 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 05:38:48.733419 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 05:38:48.733419 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 05:38:48.733419 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 05:38:48.733419 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 05:38:48.733419 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9162e60-7996-4d4d-964f-6844383357b6 could not be found. Jul 28 05:38:48.733419 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:48.733419 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:38:48.733419 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:48.733419 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:38:48.733419 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:38:48.733419 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:38:48.733419 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 05:38:48.733419 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 05:38:48.733419 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 05:38:48.738916 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:38:48.738916 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 05:38:48.738916 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 05:38:48.738916 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 05:38:48.738916 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 05:38:48.738916 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 05:38:48.738916 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 05:38:48.738916 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9162e60-7996-4d4d-964f-6844383357b6 could not be found. Jul 28 05:38:48.738916 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:48.738916 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:38:48.738916 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:48.738916 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:38:48.738916 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:38:48.738916 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:38:48.738916 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 05:38:48.738916 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 05:38:48.738916 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9162e60-7996-4d4d-964f-6844383357b6 could not be found. Jul 28 05:38:48.738916 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:48.739949 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-131c2c7a-8504-4754-a476-ed29c969d10c tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Returning 404 to user: Instance b9162e60-7996-4d4d-964f-6844383357b6 could not be found. {{(pid=124482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 05:38:48.739949 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-131c2c7a-8504-4754-a476-ed29c969d10c tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/b9162e60-7996-4d4d-964f-6844383357b6" status: 404 len: 111 microversion: 2.1 time: 0.029076 Jul 28 05:38:48.739949 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 671/895] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:38:48 2022] GET /compute/v2.1/servers/b9162e60-7996-4d4d-964f-6844383357b6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 05:38:48.745031 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-f2651d67-479d-4e5a-9805-d12ea312a402 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:48.745541 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-f2651d67-479d-4e5a-9805-d12ea312a402 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: d2380b3f-75da-4c71-9bf5-bc1b1cb0611b] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:48.751676 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f2651d67-479d-4e5a-9805-d12ea312a402 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:48.752114 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f2651d67-479d-4e5a-9805-d12ea312a402 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:48.753498 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f2651d67-479d-4e5a-9805-d12ea312a402 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:48.754300 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f2651d67-479d-4e5a-9805-d12ea312a402 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:48.768291 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.wsgi [None req-f2651d67-479d-4e5a-9805-d12ea312a402 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] HTTP exception thrown: Instance d2380b3f-75da-4c71-9bf5-bc1b1cb0611b could not be found. Jul 28 05:38:48.770668 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-f2651d67-479d-4e5a-9805-d12ea312a402 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Request method failure captured: Jul 28 05:38:48.770668 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: request: DELETE /compute/v2.1/servers/d2380b3f-75da-4c71-9bf5-bc1b1cb0611b HTTP/1.1 Jul 28 05:38:48.770668 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept: application/json Jul 28 05:38:48.770668 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept-Encoding: identity Jul 28 05:38:48.770668 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Connection: close Jul 28 05:38:48.770668 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Length: 0 Jul 28 05:38:48.770668 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Type: application/json Jul 28 05:38:48.770668 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Host: 10.222.0.33 Jul 28 05:38:48.770668 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Openstack-System-Scope: None Jul 28 05:38:48.770668 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: User-Agent: python-urllib3/1.26.10 Jul 28 05:38:48.770668 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Auth-Token: gAAAAABi4h9D_G9i011T28yIc-ZNvejV_UpI0QoKlXE0FGZ91QFBkrT7qoFtXVHh-pu6aHMGmM56LTiBsS724USe_vuB1sVPXPQos6zopSWxHNIiTv0vnR9zJg55cl6dG7-t6mrt4b6a18Xfa5nEVVolwB-FkmudbFUJziZU1gufozNL3J-fAhg Jul 28 05:38:48.770668 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Id: None Jul 28 05:38:48.770668 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Name: None Jul 28 05:38:48.770668 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Identity-Status: Confirmed Jul 28 05:38:48.770668 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Is-Admin-Project: True Jul 28 05:38:48.770668 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Id: default Jul 28 05:38:48.770668 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Name: Default Jul 28 05:38:48.770668 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Id: ba0b7f7639504a25a73c94335d62b98f Jul 28 05:38:48.770668 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Name: tempest-AttachVolumeNegativeTest-1557602675 Jul 28 05:38:48.770668 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Role: member,reader Jul 28 05:38:48.770668 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Roles: member,reader Jul 28 05:38:48.772247 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ba0b7f7639504a25a73c94335d62b98f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ba0b7f7639504a25a73c94335d62b98f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ba0b7f7639504a25a73c94335d62b98f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ba0b7f7639504a25a73c94335d62b98f"}]}] Jul 28 05:38:48.772247 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant: tempest-AttachVolumeNegativeTest-1557602675 Jul 28 05:38:48.772247 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Id: ba0b7f7639504a25a73c94335d62b98f Jul 28 05:38:48.772247 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1557602675 Jul 28 05:38:48.772247 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User: tempest-AttachVolumeNegativeTest-1557602675-project Jul 28 05:38:48.772247 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Id: default Jul 28 05:38:48.772247 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Name: Default Jul 28 05:38:48.772247 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Id: 0002ebbc629b4dafb109dc94450fe1d8 Jul 28 05:38:48.772247 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Name: tempest-AttachVolumeNegativeTest-1557602675-project Jul 28 05:38:48.772247 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: method: > Jul 28 05:38:48.772247 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: exception: Instance d2380b3f-75da-4c71-9bf5-bc1b1cb0611b could not be found. Jul 28 05:38:48.772247 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: action_args: {'id': 'd2380b3f-75da-4c71-9bf5-bc1b1cb0611b'} Jul 28 05:38:48.773127 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 05:38:48.773127 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:38:48.773127 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 05:38:48.773127 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 05:38:48.773127 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 05:38:48.773127 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 05:38:48.773127 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 05:38:48.773127 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 05:38:48.773127 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 05:38:48.773127 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 05:38:48.773127 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2380b3f-75da-4c71-9bf5-bc1b1cb0611b could not be found. Jul 28 05:38:48.773127 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:48.773127 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:38:48.773127 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:48.773127 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:38:48.773127 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:38:48.773127 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:38:48.773127 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 05:38:48.773127 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 05:38:48.773127 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 05:38:48.780062 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:38:48.780062 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 05:38:48.780062 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 05:38:48.780062 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 05:38:48.780062 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 05:38:48.780062 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 05:38:48.780062 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 05:38:48.780062 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 05:38:48.780062 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 05:38:48.780062 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2380b3f-75da-4c71-9bf5-bc1b1cb0611b could not be found. Jul 28 05:38:48.780062 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:48.780062 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:38:48.780062 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:48.780062 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:38:48.780062 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:38:48.780062 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:38:48.780062 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 05:38:48.780062 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 05:38:48.780062 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2380b3f-75da-4c71-9bf5-bc1b1cb0611b could not be found. Jul 28 05:38:48.780062 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:48.781462 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-f2651d67-479d-4e5a-9805-d12ea312a402 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Returning 404 to user: Instance d2380b3f-75da-4c71-9bf5-bc1b1cb0611b could not be found. {{(pid=124482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 05:38:48.781462 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-f2651d67-479d-4e5a-9805-d12ea312a402 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d2380b3f-75da-4c71-9bf5-bc1b1cb0611b" status: 404 len: 111 microversion: 2.1 time: 0.031052 Jul 28 05:38:48.781462 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 672/896] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Jul 28 05:38:48 2022] DELETE /compute/v2.1/servers/d2380b3f-75da-4c71-9bf5-bc1b1cb0611b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 05:38:48.786288 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-264ba7d5-7549-43d5-933c-c7b5f830e195 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:48.786935 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-264ba7d5-7549-43d5-933c-c7b5f830e195 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: d2380b3f-75da-4c71-9bf5-bc1b1cb0611b] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:48.792972 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-264ba7d5-7549-43d5-933c-c7b5f830e195 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:48.793418 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-264ba7d5-7549-43d5-933c-c7b5f830e195 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:48.794215 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-264ba7d5-7549-43d5-933c-c7b5f830e195 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:48.794653 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-264ba7d5-7549-43d5-933c-c7b5f830e195 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:48.808521 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.wsgi [None req-264ba7d5-7549-43d5-933c-c7b5f830e195 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] HTTP exception thrown: Instance d2380b3f-75da-4c71-9bf5-bc1b1cb0611b could not be found. Jul 28 05:38:48.810081 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-264ba7d5-7549-43d5-933c-c7b5f830e195 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Request method failure captured: Jul 28 05:38:48.810081 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: request: GET /compute/v2.1/servers/d2380b3f-75da-4c71-9bf5-bc1b1cb0611b HTTP/1.1 Jul 28 05:38:48.810081 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept: application/json Jul 28 05:38:48.810081 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept-Encoding: identity Jul 28 05:38:48.810081 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Connection: close Jul 28 05:38:48.810081 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Length: 0 Jul 28 05:38:48.810081 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Type: application/json Jul 28 05:38:48.810081 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Host: 10.222.0.33 Jul 28 05:38:48.810081 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Openstack-System-Scope: None Jul 28 05:38:48.810081 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: User-Agent: python-urllib3/1.26.10 Jul 28 05:38:48.810081 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Auth-Token: gAAAAABi4h9D_G9i011T28yIc-ZNvejV_UpI0QoKlXE0FGZ91QFBkrT7qoFtXVHh-pu6aHMGmM56LTiBsS724USe_vuB1sVPXPQos6zopSWxHNIiTv0vnR9zJg55cl6dG7-t6mrt4b6a18Xfa5nEVVolwB-FkmudbFUJziZU1gufozNL3J-fAhg Jul 28 05:38:48.810081 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Id: None Jul 28 05:38:48.810081 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Name: None Jul 28 05:38:48.810081 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Identity-Status: Confirmed Jul 28 05:38:48.810081 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Is-Admin-Project: True Jul 28 05:38:48.810081 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Id: default Jul 28 05:38:48.810081 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Name: Default Jul 28 05:38:48.810081 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Id: ba0b7f7639504a25a73c94335d62b98f Jul 28 05:38:48.810081 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Name: tempest-AttachVolumeNegativeTest-1557602675 Jul 28 05:38:48.810081 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Role: member,reader Jul 28 05:38:48.810081 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Roles: member,reader Jul 28 05:38:48.811571 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ba0b7f7639504a25a73c94335d62b98f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ba0b7f7639504a25a73c94335d62b98f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ba0b7f7639504a25a73c94335d62b98f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ba0b7f7639504a25a73c94335d62b98f"}]}] Jul 28 05:38:48.811571 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant: tempest-AttachVolumeNegativeTest-1557602675 Jul 28 05:38:48.811571 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Id: ba0b7f7639504a25a73c94335d62b98f Jul 28 05:38:48.811571 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1557602675 Jul 28 05:38:48.811571 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User: tempest-AttachVolumeNegativeTest-1557602675-project Jul 28 05:38:48.811571 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Id: default Jul 28 05:38:48.811571 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Name: Default Jul 28 05:38:48.811571 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Id: 0002ebbc629b4dafb109dc94450fe1d8 Jul 28 05:38:48.811571 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Name: tempest-AttachVolumeNegativeTest-1557602675-project Jul 28 05:38:48.811571 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: method: > Jul 28 05:38:48.811571 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: exception: Instance d2380b3f-75da-4c71-9bf5-bc1b1cb0611b could not be found. Jul 28 05:38:48.811571 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: action_args: {'id': 'd2380b3f-75da-4c71-9bf5-bc1b1cb0611b'} Jul 28 05:38:48.812356 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 05:38:48.812356 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:38:48.812356 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 05:38:48.812356 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 05:38:48.812356 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 05:38:48.812356 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 05:38:48.812356 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 05:38:48.812356 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 05:38:48.812356 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 05:38:48.812356 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 05:38:48.812356 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2380b3f-75da-4c71-9bf5-bc1b1cb0611b could not be found. Jul 28 05:38:48.812356 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:48.812356 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:38:48.812356 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:48.812356 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:38:48.812356 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:38:48.812356 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:38:48.812356 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 05:38:48.812356 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 05:38:48.812356 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 05:38:48.813517 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:38:48.813517 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 05:38:48.813517 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 05:38:48.813517 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 05:38:48.813517 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 05:38:48.813517 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 05:38:48.813517 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 05:38:48.813517 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2380b3f-75da-4c71-9bf5-bc1b1cb0611b could not be found. Jul 28 05:38:48.813517 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:48.813517 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:38:48.813517 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:48.813517 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:38:48.813517 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:38:48.813517 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:38:48.813517 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 05:38:48.813517 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 05:38:48.813517 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2380b3f-75da-4c71-9bf5-bc1b1cb0611b could not be found. Jul 28 05:38:48.813517 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:48.814628 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-264ba7d5-7549-43d5-933c-c7b5f830e195 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Returning 404 to user: Instance d2380b3f-75da-4c71-9bf5-bc1b1cb0611b could not be found. {{(pid=124482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 05:38:48.814628 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-264ba7d5-7549-43d5-933c-c7b5f830e195 tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/d2380b3f-75da-4c71-9bf5-bc1b1cb0611b" status: 404 len: 111 microversion: 2.1 time: 0.028979 Jul 28 05:38:48.814628 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 673/897] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:38:48 2022] GET /compute/v2.1/servers/d2380b3f-75da-4c71-9bf5-bc1b1cb0611b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 05:38:49.104262 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-1c3ca1c1-9541-4581-af84-ed85bf786e1c tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:49.104810 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-1c3ca1c1-9541-4581-af84-ed85bf786e1c tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: b4c59c70-b18e-4e7d-ad59-50b0e2e66041] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:49.110888 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1c3ca1c1-9541-4581-af84-ed85bf786e1c tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:49.111391 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1c3ca1c1-9541-4581-af84-ed85bf786e1c tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:49.113144 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1c3ca1c1-9541-4581-af84-ed85bf786e1c tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:49.113622 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1c3ca1c1-9541-4581-af84-ed85bf786e1c tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:49.128680 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.wsgi [None req-1c3ca1c1-9541-4581-af84-ed85bf786e1c tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] HTTP exception thrown: Instance b4c59c70-b18e-4e7d-ad59-50b0e2e66041 could not be found. Jul 28 05:38:49.130283 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-1c3ca1c1-9541-4581-af84-ed85bf786e1c tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Request method failure captured: Jul 28 05:38:49.130283 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: request: DELETE /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041 HTTP/1.1 Jul 28 05:38:49.130283 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept: application/json Jul 28 05:38:49.130283 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept-Encoding: identity Jul 28 05:38:49.130283 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Connection: close Jul 28 05:38:49.130283 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Length: 0 Jul 28 05:38:49.130283 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Type: application/json Jul 28 05:38:49.130283 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Host: 10.222.0.33 Jul 28 05:38:49.130283 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Openstack-System-Scope: None Jul 28 05:38:49.130283 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: User-Agent: python-urllib3/1.26.10 Jul 28 05:38:49.130283 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Auth-Token: gAAAAABi4h83Xk7EohK6Ame0qqOjGVY0juEF6cixUUoN_nYeQOByClF9kUE2WC255jRgZjiBO-WvLks3jgM32fmGkUqUx4mTlP04nY78d2XJqH99wvWbHTy--wvnzUdM8tWiTYSpYV9O6enIYtVJrTR93S-aavCuDGofU0YWMspCK5-J78eoDSU Jul 28 05:38:49.130283 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Id: None Jul 28 05:38:49.130283 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Name: None Jul 28 05:38:49.130283 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Identity-Status: Confirmed Jul 28 05:38:49.130283 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Is-Admin-Project: True Jul 28 05:38:49.130283 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Id: default Jul 28 05:38:49.130283 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Name: Default Jul 28 05:38:49.130283 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Id: 7b96e460476f4bc9b35224e38b33f4c7 Jul 28 05:38:49.130283 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Name: tempest-AttachVolumeTestJSON-419609059 Jul 28 05:38:49.130283 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Role: member,reader Jul 28 05:38:49.130283 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Roles: member,reader Jul 28 05:38:49.136312 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7b96e460476f4bc9b35224e38b33f4c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7b96e460476f4bc9b35224e38b33f4c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7b96e460476f4bc9b35224e38b33f4c7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7b96e460476f4bc9b35224e38b33f4c7"}]}] Jul 28 05:38:49.136312 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant: tempest-AttachVolumeTestJSON-419609059 Jul 28 05:38:49.136312 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Id: 7b96e460476f4bc9b35224e38b33f4c7 Jul 28 05:38:49.136312 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Name: tempest-AttachVolumeTestJSON-419609059 Jul 28 05:38:49.136312 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User: tempest-AttachVolumeTestJSON-419609059-project Jul 28 05:38:49.136312 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Id: default Jul 28 05:38:49.136312 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Name: Default Jul 28 05:38:49.136312 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Id: b3c43b517c8a464c93f0ce620826ad35 Jul 28 05:38:49.136312 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Name: tempest-AttachVolumeTestJSON-419609059-project Jul 28 05:38:49.136312 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: method: > Jul 28 05:38:49.136312 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: exception: Instance b4c59c70-b18e-4e7d-ad59-50b0e2e66041 could not be found. Jul 28 05:38:49.136312 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: action_args: {'id': 'b4c59c70-b18e-4e7d-ad59-50b0e2e66041'} Jul 28 05:38:49.137188 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 05:38:49.137188 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:38:49.137188 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 05:38:49.137188 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 05:38:49.137188 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 05:38:49.137188 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 05:38:49.137188 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 05:38:49.137188 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 05:38:49.137188 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 05:38:49.137188 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 05:38:49.137188 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4c59c70-b18e-4e7d-ad59-50b0e2e66041 could not be found. Jul 28 05:38:49.137188 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:49.137188 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:38:49.137188 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:49.137188 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:38:49.137188 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:38:49.137188 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:38:49.137188 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 05:38:49.137188 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 05:38:49.137188 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 05:38:49.138625 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:38:49.138625 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 05:38:49.138625 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 05:38:49.138625 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 05:38:49.138625 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 05:38:49.138625 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 05:38:49.138625 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 05:38:49.138625 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 05:38:49.138625 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 05:38:49.138625 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4c59c70-b18e-4e7d-ad59-50b0e2e66041 could not be found. Jul 28 05:38:49.138625 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:49.138625 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:38:49.138625 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:49.138625 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:38:49.138625 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:38:49.138625 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:38:49.138625 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 05:38:49.138625 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 05:38:49.138625 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4c59c70-b18e-4e7d-ad59-50b0e2e66041 could not be found. Jul 28 05:38:49.138625 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:49.140025 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-1c3ca1c1-9541-4581-af84-ed85bf786e1c tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Returning 404 to user: Instance b4c59c70-b18e-4e7d-ad59-50b0e2e66041 could not be found. {{(pid=124482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 05:38:49.140025 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-1c3ca1c1-9541-4581-af84-ed85bf786e1c tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041" status: 404 len: 111 microversion: 2.1 time: 0.031264 Jul 28 05:38:49.140025 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 674/898] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Jul 28 05:38:49 2022] DELETE /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 05:38:49.140025 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-fe7c9564-5cfc-47ce-ac6e-dc45b6cd5d3b tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:49.140621 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-fe7c9564-5cfc-47ce-ac6e-dc45b6cd5d3b tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: b4c59c70-b18e-4e7d-ad59-50b0e2e66041] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:49.146958 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-fe7c9564-5cfc-47ce-ac6e-dc45b6cd5d3b tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:49.147404 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-fe7c9564-5cfc-47ce-ac6e-dc45b6cd5d3b tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:49.148147 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-fe7c9564-5cfc-47ce-ac6e-dc45b6cd5d3b tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:49.148579 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-fe7c9564-5cfc-47ce-ac6e-dc45b6cd5d3b tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:49.162596 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.wsgi [None req-fe7c9564-5cfc-47ce-ac6e-dc45b6cd5d3b tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] HTTP exception thrown: Instance b4c59c70-b18e-4e7d-ad59-50b0e2e66041 could not be found. Jul 28 05:38:49.164063 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-fe7c9564-5cfc-47ce-ac6e-dc45b6cd5d3b tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Request method failure captured: Jul 28 05:38:49.164063 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: request: GET /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041 HTTP/1.1 Jul 28 05:38:49.164063 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept: application/json Jul 28 05:38:49.164063 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept-Encoding: identity Jul 28 05:38:49.164063 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Connection: close Jul 28 05:38:49.164063 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Length: 0 Jul 28 05:38:49.164063 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Type: application/json Jul 28 05:38:49.164063 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Host: 10.222.0.33 Jul 28 05:38:49.164063 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Openstack-System-Scope: None Jul 28 05:38:49.164063 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: User-Agent: python-urllib3/1.26.10 Jul 28 05:38:49.164063 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Auth-Token: gAAAAABi4h83Xk7EohK6Ame0qqOjGVY0juEF6cixUUoN_nYeQOByClF9kUE2WC255jRgZjiBO-WvLks3jgM32fmGkUqUx4mTlP04nY78d2XJqH99wvWbHTy--wvnzUdM8tWiTYSpYV9O6enIYtVJrTR93S-aavCuDGofU0YWMspCK5-J78eoDSU Jul 28 05:38:49.164063 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Id: None Jul 28 05:38:49.164063 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Name: None Jul 28 05:38:49.164063 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Identity-Status: Confirmed Jul 28 05:38:49.164063 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Is-Admin-Project: True Jul 28 05:38:49.164063 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Id: default Jul 28 05:38:49.164063 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Name: Default Jul 28 05:38:49.164063 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Id: 7b96e460476f4bc9b35224e38b33f4c7 Jul 28 05:38:49.164063 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Name: tempest-AttachVolumeTestJSON-419609059 Jul 28 05:38:49.164063 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Role: member,reader Jul 28 05:38:49.164063 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Roles: member,reader Jul 28 05:38:49.165583 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7b96e460476f4bc9b35224e38b33f4c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7b96e460476f4bc9b35224e38b33f4c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7b96e460476f4bc9b35224e38b33f4c7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7b96e460476f4bc9b35224e38b33f4c7"}]}] Jul 28 05:38:49.165583 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant: tempest-AttachVolumeTestJSON-419609059 Jul 28 05:38:49.165583 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Id: 7b96e460476f4bc9b35224e38b33f4c7 Jul 28 05:38:49.165583 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Name: tempest-AttachVolumeTestJSON-419609059 Jul 28 05:38:49.165583 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User: tempest-AttachVolumeTestJSON-419609059-project Jul 28 05:38:49.165583 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Id: default Jul 28 05:38:49.165583 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Name: Default Jul 28 05:38:49.165583 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Id: b3c43b517c8a464c93f0ce620826ad35 Jul 28 05:38:49.165583 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Name: tempest-AttachVolumeTestJSON-419609059-project Jul 28 05:38:49.165583 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: method: > Jul 28 05:38:49.165583 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: exception: Instance b4c59c70-b18e-4e7d-ad59-50b0e2e66041 could not be found. Jul 28 05:38:49.165583 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: action_args: {'id': 'b4c59c70-b18e-4e7d-ad59-50b0e2e66041'} Jul 28 05:38:49.166437 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 05:38:49.166437 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:38:49.166437 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 05:38:49.166437 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 05:38:49.166437 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 05:38:49.166437 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 05:38:49.166437 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 05:38:49.166437 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 05:38:49.166437 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 05:38:49.166437 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 05:38:49.166437 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4c59c70-b18e-4e7d-ad59-50b0e2e66041 could not be found. Jul 28 05:38:49.166437 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:49.166437 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:38:49.166437 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:49.166437 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:38:49.166437 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:38:49.166437 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:38:49.166437 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 05:38:49.166437 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 05:38:49.166437 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 05:38:49.167806 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:38:49.167806 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 05:38:49.167806 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 05:38:49.167806 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 05:38:49.167806 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 05:38:49.167806 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 05:38:49.167806 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 05:38:49.167806 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4c59c70-b18e-4e7d-ad59-50b0e2e66041 could not be found. Jul 28 05:38:49.167806 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:49.167806 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:38:49.167806 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:49.167806 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:38:49.167806 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:38:49.167806 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:38:49.167806 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 05:38:49.167806 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 05:38:49.167806 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4c59c70-b18e-4e7d-ad59-50b0e2e66041 could not be found. Jul 28 05:38:49.167806 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:49.169339 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-fe7c9564-5cfc-47ce-ac6e-dc45b6cd5d3b tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Returning 404 to user: Instance b4c59c70-b18e-4e7d-ad59-50b0e2e66041 could not be found. {{(pid=124482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 05:38:49.169339 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-fe7c9564-5cfc-47ce-ac6e-dc45b6cd5d3b tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041" status: 404 len: 111 microversion: 2.1 time: 0.029022 Jul 28 05:38:49.169339 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 675/899] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:38:49 2022] GET /compute/v2.1/servers/b4c59c70-b18e-4e7d-ad59-50b0e2e66041 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 05:38:50.070693 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-d5c13b38-3126-4c46-ae03-dec5dc110abc tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:50.071318 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-d5c13b38-3126-4c46-ae03-dec5dc110abc tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: f769843b-cb4a-4599-bf54-49d579601a8a] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:50.078626 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d5c13b38-3126-4c46-ae03-dec5dc110abc tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:50.079117 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d5c13b38-3126-4c46-ae03-dec5dc110abc tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:50.079885 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d5c13b38-3126-4c46-ae03-dec5dc110abc tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:50.080313 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d5c13b38-3126-4c46-ae03-dec5dc110abc tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:50.094961 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.wsgi [None req-d5c13b38-3126-4c46-ae03-dec5dc110abc tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] HTTP exception thrown: Instance f769843b-cb4a-4599-bf54-49d579601a8a could not be found. Jul 28 05:38:50.102560 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-d5c13b38-3126-4c46-ae03-dec5dc110abc tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Request method failure captured: Jul 28 05:38:50.102560 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: request: DELETE /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a HTTP/1.1 Jul 28 05:38:50.102560 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept: application/json Jul 28 05:38:50.102560 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept-Encoding: identity Jul 28 05:38:50.102560 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Connection: close Jul 28 05:38:50.102560 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Length: 0 Jul 28 05:38:50.102560 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Type: application/json Jul 28 05:38:50.102560 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Host: 10.222.0.33 Jul 28 05:38:50.102560 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Openstack-System-Scope: None Jul 28 05:38:50.102560 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: User-Agent: python-urllib3/1.26.10 Jul 28 05:38:50.102560 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Auth-Token: gAAAAABi4h9D_G9i011T28yIc-ZNvejV_UpI0QoKlXE0FGZ91QFBkrT7qoFtXVHh-pu6aHMGmM56LTiBsS724USe_vuB1sVPXPQos6zopSWxHNIiTv0vnR9zJg55cl6dG7-t6mrt4b6a18Xfa5nEVVolwB-FkmudbFUJziZU1gufozNL3J-fAhg Jul 28 05:38:50.102560 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Id: None Jul 28 05:38:50.102560 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Name: None Jul 28 05:38:50.102560 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Identity-Status: Confirmed Jul 28 05:38:50.102560 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Is-Admin-Project: True Jul 28 05:38:50.102560 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Id: default Jul 28 05:38:50.102560 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Name: Default Jul 28 05:38:50.102560 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Id: ba0b7f7639504a25a73c94335d62b98f Jul 28 05:38:50.102560 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Name: tempest-AttachVolumeNegativeTest-1557602675 Jul 28 05:38:50.102560 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Role: member,reader Jul 28 05:38:50.102560 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Roles: member,reader Jul 28 05:38:50.104085 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ba0b7f7639504a25a73c94335d62b98f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ba0b7f7639504a25a73c94335d62b98f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ba0b7f7639504a25a73c94335d62b98f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ba0b7f7639504a25a73c94335d62b98f"}]}] Jul 28 05:38:50.104085 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant: tempest-AttachVolumeNegativeTest-1557602675 Jul 28 05:38:50.104085 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Id: ba0b7f7639504a25a73c94335d62b98f Jul 28 05:38:50.104085 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1557602675 Jul 28 05:38:50.104085 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User: tempest-AttachVolumeNegativeTest-1557602675-project Jul 28 05:38:50.104085 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Id: default Jul 28 05:38:50.104085 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Name: Default Jul 28 05:38:50.104085 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Id: 0002ebbc629b4dafb109dc94450fe1d8 Jul 28 05:38:50.104085 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Name: tempest-AttachVolumeNegativeTest-1557602675-project Jul 28 05:38:50.104085 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: method: > Jul 28 05:38:50.104085 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: exception: Instance f769843b-cb4a-4599-bf54-49d579601a8a could not be found. Jul 28 05:38:50.104085 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: action_args: {'id': 'f769843b-cb4a-4599-bf54-49d579601a8a'} Jul 28 05:38:50.104982 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 05:38:50.104982 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:38:50.104982 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 05:38:50.104982 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 05:38:50.104982 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 05:38:50.104982 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 05:38:50.104982 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 05:38:50.104982 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 05:38:50.104982 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 05:38:50.104982 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 05:38:50.104982 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f769843b-cb4a-4599-bf54-49d579601a8a could not be found. Jul 28 05:38:50.104982 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:50.104982 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:38:50.104982 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:50.104982 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:38:50.104982 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:38:50.104982 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:38:50.104982 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 05:38:50.104982 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 05:38:50.104982 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 05:38:50.106421 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:38:50.106421 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 05:38:50.106421 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 05:38:50.106421 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 05:38:50.106421 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 05:38:50.106421 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 05:38:50.106421 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 05:38:50.106421 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 05:38:50.106421 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 05:38:50.106421 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f769843b-cb4a-4599-bf54-49d579601a8a could not be found. Jul 28 05:38:50.106421 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:50.106421 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:38:50.106421 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:50.106421 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:38:50.106421 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:38:50.106421 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:38:50.106421 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 05:38:50.106421 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 05:38:50.106421 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f769843b-cb4a-4599-bf54-49d579601a8a could not be found. Jul 28 05:38:50.106421 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:50.107864 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-d5c13b38-3126-4c46-ae03-dec5dc110abc tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Returning 404 to user: Instance f769843b-cb4a-4599-bf54-49d579601a8a could not be found. {{(pid=124482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 05:38:50.107864 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-d5c13b38-3126-4c46-ae03-dec5dc110abc tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a" status: 404 len: 111 microversion: 2.1 time: 0.031288 Jul 28 05:38:50.107864 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 676/900] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Jul 28 05:38:50 2022] DELETE /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 05:38:50.107864 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-d4384f4b-62e0-44b7-af73-d27da23b3a2f tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:50.107864 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-d4384f4b-62e0-44b7-af73-d27da23b3a2f tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] [instance: f769843b-cb4a-4599-bf54-49d579601a8a] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:50.112332 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d4384f4b-62e0-44b7-af73-d27da23b3a2f tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:50.112833 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d4384f4b-62e0-44b7-af73-d27da23b3a2f tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:50.113628 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d4384f4b-62e0-44b7-af73-d27da23b3a2f tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:50.114310 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d4384f4b-62e0-44b7-af73-d27da23b3a2f tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:50.131568 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.wsgi [None req-d4384f4b-62e0-44b7-af73-d27da23b3a2f tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] HTTP exception thrown: Instance f769843b-cb4a-4599-bf54-49d579601a8a could not be found. Jul 28 05:38:50.133092 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-d4384f4b-62e0-44b7-af73-d27da23b3a2f tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Request method failure captured: Jul 28 05:38:50.133092 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: request: GET /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a HTTP/1.1 Jul 28 05:38:50.133092 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept: application/json Jul 28 05:38:50.133092 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept-Encoding: identity Jul 28 05:38:50.133092 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Connection: close Jul 28 05:38:50.133092 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Length: 0 Jul 28 05:38:50.133092 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Type: application/json Jul 28 05:38:50.133092 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Host: 10.222.0.33 Jul 28 05:38:50.133092 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Openstack-System-Scope: None Jul 28 05:38:50.133092 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: User-Agent: python-urllib3/1.26.10 Jul 28 05:38:50.133092 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Auth-Token: gAAAAABi4h9D_G9i011T28yIc-ZNvejV_UpI0QoKlXE0FGZ91QFBkrT7qoFtXVHh-pu6aHMGmM56LTiBsS724USe_vuB1sVPXPQos6zopSWxHNIiTv0vnR9zJg55cl6dG7-t6mrt4b6a18Xfa5nEVVolwB-FkmudbFUJziZU1gufozNL3J-fAhg Jul 28 05:38:50.133092 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Id: None Jul 28 05:38:50.133092 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Name: None Jul 28 05:38:50.133092 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Identity-Status: Confirmed Jul 28 05:38:50.133092 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Is-Admin-Project: True Jul 28 05:38:50.133092 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Id: default Jul 28 05:38:50.133092 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Name: Default Jul 28 05:38:50.133092 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Id: ba0b7f7639504a25a73c94335d62b98f Jul 28 05:38:50.133092 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Name: tempest-AttachVolumeNegativeTest-1557602675 Jul 28 05:38:50.133092 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Role: member,reader Jul 28 05:38:50.133092 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Roles: member,reader Jul 28 05:38:50.134731 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ba0b7f7639504a25a73c94335d62b98f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ba0b7f7639504a25a73c94335d62b98f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ba0b7f7639504a25a73c94335d62b98f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ba0b7f7639504a25a73c94335d62b98f"}]}] Jul 28 05:38:50.134731 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant: tempest-AttachVolumeNegativeTest-1557602675 Jul 28 05:38:50.134731 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Id: ba0b7f7639504a25a73c94335d62b98f Jul 28 05:38:50.134731 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1557602675 Jul 28 05:38:50.134731 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User: tempest-AttachVolumeNegativeTest-1557602675-project Jul 28 05:38:50.134731 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Id: default Jul 28 05:38:50.134731 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Name: Default Jul 28 05:38:50.134731 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Id: 0002ebbc629b4dafb109dc94450fe1d8 Jul 28 05:38:50.134731 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Name: tempest-AttachVolumeNegativeTest-1557602675-project Jul 28 05:38:50.134731 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: method: > Jul 28 05:38:50.134731 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: exception: Instance f769843b-cb4a-4599-bf54-49d579601a8a could not be found. Jul 28 05:38:50.134731 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: action_args: {'id': 'f769843b-cb4a-4599-bf54-49d579601a8a'} Jul 28 05:38:50.135600 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 05:38:50.135600 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:38:50.135600 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 05:38:50.135600 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 05:38:50.135600 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 05:38:50.135600 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 05:38:50.135600 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 05:38:50.135600 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 05:38:50.135600 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 05:38:50.135600 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 05:38:50.135600 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f769843b-cb4a-4599-bf54-49d579601a8a could not be found. Jul 28 05:38:50.135600 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:50.135600 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:38:50.135600 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:50.135600 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:38:50.135600 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:38:50.135600 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:38:50.135600 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 05:38:50.135600 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 05:38:50.135600 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 05:38:50.137011 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:38:50.137011 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 05:38:50.137011 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 05:38:50.137011 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 05:38:50.137011 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 05:38:50.137011 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 05:38:50.137011 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 05:38:50.137011 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f769843b-cb4a-4599-bf54-49d579601a8a could not be found. Jul 28 05:38:50.137011 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:50.137011 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:38:50.137011 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:50.137011 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:38:50.137011 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:38:50.137011 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:38:50.137011 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 05:38:50.137011 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 05:38:50.137011 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f769843b-cb4a-4599-bf54-49d579601a8a could not be found. Jul 28 05:38:50.137011 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:50.138309 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-d4384f4b-62e0-44b7-af73-d27da23b3a2f tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] Returning 404 to user: Instance f769843b-cb4a-4599-bf54-49d579601a8a could not be found. {{(pid=124482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 05:38:50.138309 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-d4384f4b-62e0-44b7-af73-d27da23b3a2f tempest-AttachVolumeNegativeTest-1557602675 tempest-AttachVolumeNegativeTest-1557602675-project] 10.222.0.33 "GET /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a" status: 404 len: 111 microversion: 2.1 time: 0.032051 Jul 28 05:38:50.138309 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 677/901] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:38:50 2022] GET /compute/v2.1/servers/f769843b-cb4a-4599-bf54-49d579601a8a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 05:38:50.515881 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-2e506f13-c26b-45d7-9855-fee38c7ccbc7 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:50.516315 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-2e506f13-c26b-45d7-9855-fee38c7ccbc7 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:50.518298 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:50.534887 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2e506f13-c26b-45d7-9855-fee38c7ccbc7 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:50.535310 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2e506f13-c26b-45d7-9855-fee38c7ccbc7 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:50.542444 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2e506f13-c26b-45d7-9855-fee38c7ccbc7 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:50.542444 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2e506f13-c26b-45d7-9855-fee38c7ccbc7 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:50.550620 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.wsgi [None req-2e506f13-c26b-45d7-9855-fee38c7ccbc7 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] HTTP exception thrown: Instance 0539d466-3f2e-414a-8563-45ad82a3f268 could not be found. Jul 28 05:38:50.552151 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-2e506f13-c26b-45d7-9855-fee38c7ccbc7 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Request method failure captured: Jul 28 05:38:50.552151 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: request: DELETE /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 HTTP/1.1 Jul 28 05:38:50.552151 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept: application/json Jul 28 05:38:50.552151 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept-Encoding: identity Jul 28 05:38:50.552151 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Connection: close Jul 28 05:38:50.552151 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Length: 0 Jul 28 05:38:50.552151 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Type: application/json Jul 28 05:38:50.552151 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Host: 10.222.0.33 Jul 28 05:38:50.552151 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Openstack-System-Scope: None Jul 28 05:38:50.552151 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: User-Agent: python-urllib3/1.26.10 Jul 28 05:38:50.552151 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Auth-Token: gAAAAABi4h83Xk7EohK6Ame0qqOjGVY0juEF6cixUUoN_nYeQOByClF9kUE2WC255jRgZjiBO-WvLks3jgM32fmGkUqUx4mTlP04nY78d2XJqH99wvWbHTy--wvnzUdM8tWiTYSpYV9O6enIYtVJrTR93S-aavCuDGofU0YWMspCK5-J78eoDSU Jul 28 05:38:50.552151 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Id: None Jul 28 05:38:50.552151 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Name: None Jul 28 05:38:50.552151 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Identity-Status: Confirmed Jul 28 05:38:50.552151 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Is-Admin-Project: True Jul 28 05:38:50.552151 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Id: default Jul 28 05:38:50.552151 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Name: Default Jul 28 05:38:50.552151 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Id: 7b96e460476f4bc9b35224e38b33f4c7 Jul 28 05:38:50.552151 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Name: tempest-AttachVolumeTestJSON-419609059 Jul 28 05:38:50.552151 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Role: member,reader Jul 28 05:38:50.552151 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Roles: member,reader Jul 28 05:38:50.553506 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7b96e460476f4bc9b35224e38b33f4c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7b96e460476f4bc9b35224e38b33f4c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7b96e460476f4bc9b35224e38b33f4c7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7b96e460476f4bc9b35224e38b33f4c7"}]}] Jul 28 05:38:50.553506 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant: tempest-AttachVolumeTestJSON-419609059 Jul 28 05:38:50.553506 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Id: 7b96e460476f4bc9b35224e38b33f4c7 Jul 28 05:38:50.553506 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Name: tempest-AttachVolumeTestJSON-419609059 Jul 28 05:38:50.553506 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User: tempest-AttachVolumeTestJSON-419609059-project Jul 28 05:38:50.553506 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Id: default Jul 28 05:38:50.553506 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Name: Default Jul 28 05:38:50.553506 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Id: b3c43b517c8a464c93f0ce620826ad35 Jul 28 05:38:50.553506 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Name: tempest-AttachVolumeTestJSON-419609059-project Jul 28 05:38:50.553506 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: method: > Jul 28 05:38:50.553506 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: exception: Instance 0539d466-3f2e-414a-8563-45ad82a3f268 could not be found. Jul 28 05:38:50.553506 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: action_args: {'id': '0539d466-3f2e-414a-8563-45ad82a3f268'} Jul 28 05:38:50.554237 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 05:38:50.554237 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:38:50.554237 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 05:38:50.554237 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 05:38:50.554237 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 05:38:50.554237 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 05:38:50.554237 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 05:38:50.554237 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 05:38:50.554237 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 05:38:50.554237 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 05:38:50.554237 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0539d466-3f2e-414a-8563-45ad82a3f268 could not be found. Jul 28 05:38:50.554237 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:50.554237 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:38:50.554237 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:50.554237 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:38:50.554237 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:38:50.554237 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:38:50.554237 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 05:38:50.554237 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 05:38:50.554237 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 05:38:50.555451 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:38:50.555451 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 05:38:50.555451 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 05:38:50.555451 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 05:38:50.555451 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 05:38:50.555451 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 05:38:50.555451 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 05:38:50.555451 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 05:38:50.555451 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 05:38:50.555451 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0539d466-3f2e-414a-8563-45ad82a3f268 could not be found. Jul 28 05:38:50.555451 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:50.555451 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:38:50.555451 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:50.555451 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:38:50.555451 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:38:50.555451 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:38:50.555451 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 05:38:50.555451 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 05:38:50.555451 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0539d466-3f2e-414a-8563-45ad82a3f268 could not be found. Jul 28 05:38:50.555451 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:50.556702 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-2e506f13-c26b-45d7-9855-fee38c7ccbc7 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Returning 404 to user: Instance 0539d466-3f2e-414a-8563-45ad82a3f268 could not be found. {{(pid=124482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 05:38:50.556702 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-2e506f13-c26b-45d7-9855-fee38c7ccbc7 tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 404 len: 111 microversion: 2.1 time: 0.041511 Jul 28 05:38:50.556702 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 678/902] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Jul 28 05:38:50 2022] DELETE /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 05:38:50.562379 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-f5a927bc-df9d-4b10-9462-92d40992509a tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:50.562987 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-f5a927bc-df9d-4b10-9462-92d40992509a tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] [instance: 0539d466-3f2e-414a-8563-45ad82a3f268] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:50.570157 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f5a927bc-df9d-4b10-9462-92d40992509a tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:50.571608 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f5a927bc-df9d-4b10-9462-92d40992509a tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:50.571608 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f5a927bc-df9d-4b10-9462-92d40992509a tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:50.571796 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f5a927bc-df9d-4b10-9462-92d40992509a tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:50.587435 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.wsgi [None req-f5a927bc-df9d-4b10-9462-92d40992509a tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] HTTP exception thrown: Instance 0539d466-3f2e-414a-8563-45ad82a3f268 could not be found. Jul 28 05:38:50.588993 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-f5a927bc-df9d-4b10-9462-92d40992509a tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Request method failure captured: Jul 28 05:38:50.588993 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: request: GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 HTTP/1.1 Jul 28 05:38:50.588993 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept: application/json Jul 28 05:38:50.588993 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept-Encoding: identity Jul 28 05:38:50.588993 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Connection: close Jul 28 05:38:50.588993 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Length: 0 Jul 28 05:38:50.588993 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Type: application/json Jul 28 05:38:50.588993 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Host: 10.222.0.33 Jul 28 05:38:50.588993 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Openstack-System-Scope: None Jul 28 05:38:50.588993 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: User-Agent: python-urllib3/1.26.10 Jul 28 05:38:50.588993 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Auth-Token: gAAAAABi4h83Xk7EohK6Ame0qqOjGVY0juEF6cixUUoN_nYeQOByClF9kUE2WC255jRgZjiBO-WvLks3jgM32fmGkUqUx4mTlP04nY78d2XJqH99wvWbHTy--wvnzUdM8tWiTYSpYV9O6enIYtVJrTR93S-aavCuDGofU0YWMspCK5-J78eoDSU Jul 28 05:38:50.588993 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Id: None Jul 28 05:38:50.588993 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Name: None Jul 28 05:38:50.588993 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Identity-Status: Confirmed Jul 28 05:38:50.588993 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Is-Admin-Project: True Jul 28 05:38:50.588993 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Id: default Jul 28 05:38:50.588993 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Name: Default Jul 28 05:38:50.588993 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Id: 7b96e460476f4bc9b35224e38b33f4c7 Jul 28 05:38:50.588993 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Name: tempest-AttachVolumeTestJSON-419609059 Jul 28 05:38:50.588993 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Role: member,reader Jul 28 05:38:50.588993 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Roles: member,reader Jul 28 05:38:50.590421 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7b96e460476f4bc9b35224e38b33f4c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7b96e460476f4bc9b35224e38b33f4c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7b96e460476f4bc9b35224e38b33f4c7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7b96e460476f4bc9b35224e38b33f4c7"}]}] Jul 28 05:38:50.590421 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant: tempest-AttachVolumeTestJSON-419609059 Jul 28 05:38:50.590421 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Id: 7b96e460476f4bc9b35224e38b33f4c7 Jul 28 05:38:50.590421 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Name: tempest-AttachVolumeTestJSON-419609059 Jul 28 05:38:50.590421 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User: tempest-AttachVolumeTestJSON-419609059-project Jul 28 05:38:50.590421 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Id: default Jul 28 05:38:50.590421 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Name: Default Jul 28 05:38:50.590421 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Id: b3c43b517c8a464c93f0ce620826ad35 Jul 28 05:38:50.590421 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Name: tempest-AttachVolumeTestJSON-419609059-project Jul 28 05:38:50.590421 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: method: > Jul 28 05:38:50.590421 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: exception: Instance 0539d466-3f2e-414a-8563-45ad82a3f268 could not be found. Jul 28 05:38:50.590421 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: action_args: {'id': '0539d466-3f2e-414a-8563-45ad82a3f268'} Jul 28 05:38:50.591130 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 05:38:50.591130 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:38:50.591130 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 05:38:50.591130 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 05:38:50.591130 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 05:38:50.591130 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 05:38:50.591130 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 05:38:50.591130 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 05:38:50.591130 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 05:38:50.591130 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 05:38:50.591130 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0539d466-3f2e-414a-8563-45ad82a3f268 could not be found. Jul 28 05:38:50.591130 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:50.591130 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:38:50.591130 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:50.591130 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:38:50.591130 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:38:50.591130 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:38:50.591130 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 05:38:50.591130 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 05:38:50.591130 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 05:38:50.592282 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:38:50.592282 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 05:38:50.592282 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 05:38:50.592282 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 05:38:50.592282 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 05:38:50.592282 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 05:38:50.592282 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 05:38:50.592282 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0539d466-3f2e-414a-8563-45ad82a3f268 could not be found. Jul 28 05:38:50.592282 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:50.592282 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:38:50.592282 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:50.592282 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:38:50.592282 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:38:50.592282 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:38:50.592282 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 05:38:50.592282 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 05:38:50.592282 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0539d466-3f2e-414a-8563-45ad82a3f268 could not be found. Jul 28 05:38:50.592282 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:50.593335 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-f5a927bc-df9d-4b10-9462-92d40992509a tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] Returning 404 to user: Instance 0539d466-3f2e-414a-8563-45ad82a3f268 could not be found. {{(pid=124482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 05:38:50.593335 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-f5a927bc-df9d-4b10-9462-92d40992509a tempest-AttachVolumeTestJSON-419609059 tempest-AttachVolumeTestJSON-419609059-project] 10.222.0.33 "GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268" status: 404 len: 111 microversion: 2.1 time: 0.032223 Jul 28 05:38:50.593335 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 679/903] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:38:50 2022] GET /compute/v2.1/servers/0539d466-3f2e-414a-8563-45ad82a3f268 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 05:38:50.965523 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-4a7ca56d-dd04-444f-bb9e-e529bcfb9a2a tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:50.968083 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-4a7ca56d-dd04-444f-bb9e-e529bcfb9a2a tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:50.975917 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4a7ca56d-dd04-444f-bb9e-e529bcfb9a2a tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:50.976834 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4a7ca56d-dd04-444f-bb9e-e529bcfb9a2a tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:50.977911 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4a7ca56d-dd04-444f-bb9e-e529bcfb9a2a tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:50.978546 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4a7ca56d-dd04-444f-bb9e-e529bcfb9a2a tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:51.012139 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-4a7ca56d-dd04-444f-bb9e-e529bcfb9a2a tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050507 Jul 28 05:38:51.022223 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 680/904] 10.222.0.33 () {60 vars in 1343 bytes} [Thu Jul 28 05:38:50 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:38:51.092325 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-22db5e14-2a48-4ec1-90a8-0189763ef770 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:51.093977 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-22db5e14-2a48-4ec1-90a8-0189763ef770 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:51.102236 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-22db5e14-2a48-4ec1-90a8-0189763ef770 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:51.103051 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-22db5e14-2a48-4ec1-90a8-0189763ef770 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:51.104065 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-22db5e14-2a48-4ec1-90a8-0189763ef770 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:51.104745 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-22db5e14-2a48-4ec1-90a8-0189763ef770 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:51.134664 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-22db5e14-2a48-4ec1-90a8-0189763ef770 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Going to try to terminate instance {{(pid=124482) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 05:38:51.168811 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell1:SELECT=100 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:51.441202 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-22db5e14-2a48-4ec1-90a8-0189763ef770 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "DELETE /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 204 len: 0 microversion: 2.20 time: 0.354459 Jul 28 05:38:51.441748 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 681/905] 10.222.0.33 () {60 vars in 1280 bytes} [Thu Jul 28 05:38:51 2022] DELETE /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 28 05:38:51.454280 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-73788953-ed55-47df-9147-597e813777dd tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:51.455065 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-73788953-ed55-47df-9147-597e813777dd tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:51.461345 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-73788953-ed55-47df-9147-597e813777dd tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:51.462063 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-73788953-ed55-47df-9147-597e813777dd tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:51.464985 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-73788953-ed55-47df-9147-597e813777dd tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:51.464985 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-73788953-ed55-47df-9147-597e813777dd tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:51.628602 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-73788953-ed55-47df-9147-597e813777dd tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:38:51.637837 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-73788953-ed55-47df-9147-597e813777dd tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:38:51.639471 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-73788953-ed55-47df-9147-597e813777dd tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:38:51.640816 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-73788953-ed55-47df-9147-597e813777dd tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 200 len: 1725 microversion: 2.20 time: 0.190680 Jul 28 05:38:51.641226 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 682/906] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:38:51 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 1725 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:38:52.666357 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-c807b894-d0be-474e-a3de-bc4b89a6cac7 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:52.667789 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-c807b894-d0be-474e-a3de-bc4b89a6cac7 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:52.678623 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c807b894-d0be-474e-a3de-bc4b89a6cac7 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:52.679409 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c807b894-d0be-474e-a3de-bc4b89a6cac7 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:52.680418 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c807b894-d0be-474e-a3de-bc4b89a6cac7 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:52.681683 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c807b894-d0be-474e-a3de-bc4b89a6cac7 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:53.044147 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-c807b894-d0be-474e-a3de-bc4b89a6cac7 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:38:53.062066 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-c807b894-d0be-474e-a3de-bc4b89a6cac7 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:38:53.064652 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-c807b894-d0be-474e-a3de-bc4b89a6cac7 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:38:53.066253 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-c807b894-d0be-474e-a3de-bc4b89a6cac7 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 200 len: 1725 microversion: 2.20 time: 0.403704 Jul 28 05:38:53.067582 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 683/907] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:38:52 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 1725 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:38:54.080243 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-2de9a733-ac3d-4550-a1d5-f3031459d139 req-fd54566d-101d-4de0-9a37-db09779e8cd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54986322-1272-4f12-a108-b8675f3190a6", "name": "network-vif-deleted", "tag": "bb48c226-cd8a-426b-8392-6dcb3d411b85"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:38:54.104870 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-2de9a733-ac3d-4550-a1d5-f3031459d139 req-fd54566d-101d-4de0-9a37-db09779e8cd2 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:54.105309 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-2de9a733-ac3d-4550-a1d5-f3031459d139 req-fd54566d-101d-4de0-9a37-db09779e8cd2 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:54.120619 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-2de9a733-ac3d-4550-a1d5-f3031459d139 req-fd54566d-101d-4de0-9a37-db09779e8cd2 service nova] Creating event network-vif-deleted:bb48c226-cd8a-426b-8392-6dcb3d411b85 for instance 54986322-1272-4f12-a108-b8675f3190a6 on hv-cinder-79987 Jul 28 05:38:54.126213 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-2de9a733-ac3d-4550-a1d5-f3031459d139 req-fd54566d-101d-4de0-9a37-db09779e8cd2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049977 Jul 28 05:38:54.131670 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 684/908] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:38:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:38:54.135334 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-e77c7546-45ca-4e00-aab2-6a8bd537a479 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:54.136267 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-e77c7546-45ca-4e00-aab2-6a8bd537a479 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:54.153492 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e77c7546-45ca-4e00-aab2-6a8bd537a479 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:54.157307 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e77c7546-45ca-4e00-aab2-6a8bd537a479 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:54.157307 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e77c7546-45ca-4e00-aab2-6a8bd537a479 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:54.157759 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e77c7546-45ca-4e00-aab2-6a8bd537a479 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:54.348247 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-e77c7546-45ca-4e00-aab2-6a8bd537a479 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:38:54.361424 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-e77c7546-45ca-4e00-aab2-6a8bd537a479 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:38:54.368081 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-e77c7546-45ca-4e00-aab2-6a8bd537a479 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22fddcc9952a459899e48a93d1d962db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e54a77d2aa469b8c0197d99170d978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:38:54.370912 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-e77c7546-45ca-4e00-aab2-6a8bd537a479 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 200 len: 1657 microversion: 2.20 time: 0.240786 Jul 28 05:38:54.372858 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 685/909] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:38:54 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 1657 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 05:38:55.400729 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-c96b4d79-39a7-4a61-a1ba-eea318c27c9e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:55.401353 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-c96b4d79-39a7-4a61-a1ba-eea318c27c9e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:55.411327 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c96b4d79-39a7-4a61-a1ba-eea318c27c9e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:55.411703 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c96b4d79-39a7-4a61-a1ba-eea318c27c9e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:55.412483 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c96b4d79-39a7-4a61-a1ba-eea318c27c9e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:55.414135 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c96b4d79-39a7-4a61-a1ba-eea318c27c9e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:55.442651 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.wsgi [None req-c96b4d79-39a7-4a61-a1ba-eea318c27c9e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] HTTP exception thrown: Instance 54986322-1272-4f12-a108-b8675f3190a6 could not be found. Jul 28 05:38:55.444207 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-c96b4d79-39a7-4a61-a1ba-eea318c27c9e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Request method failure captured: Jul 28 05:38:55.444207 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: request: GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 HTTP/1.1 Jul 28 05:38:55.444207 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept: application/json Jul 28 05:38:55.444207 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept-Encoding: identity Jul 28 05:38:55.444207 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Connection: close Jul 28 05:38:55.444207 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Length: 0 Jul 28 05:38:55.444207 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Type: application/json Jul 28 05:38:55.444207 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Host: 10.222.0.33 Jul 28 05:38:55.444207 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Openstack-System-Scope: None Jul 28 05:38:55.444207 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: User-Agent: python-urllib3/1.26.10 Jul 28 05:38:55.444207 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Auth-Token: gAAAAABi4h9B4BZ0YKk62IEiK2B7fNXnAEvmUzwRuX3HZAwpyBQuwrelM32kVXxMwMHFWRpIiF0wrQELj7IIFkWW2dNQ1l6hVjctg_7QgVgoHpLuzx0PaLQ7DgaTnloBovVfWeMHK4qw8EQUGTonIgEEe8nVn-xX6wXcJIqTwy53KhNB8eAmkus Jul 28 05:38:55.444207 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Id: None Jul 28 05:38:55.444207 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Name: None Jul 28 05:38:55.444207 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Identity-Status: Confirmed Jul 28 05:38:55.444207 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Is-Admin-Project: True Jul 28 05:38:55.444207 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 05:38:55.444207 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Id: default Jul 28 05:38:55.444207 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Name: Default Jul 28 05:38:55.444207 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Id: d6e54a77d2aa469b8c0197d99170d978 Jul 28 05:38:55.444207 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-524079106 Jul 28 05:38:55.444207 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Role: member,reader Jul 28 05:38:55.444207 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Roles: member,reader Jul 28 05:38:55.445832 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d6e54a77d2aa469b8c0197d99170d978"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d6e54a77d2aa469b8c0197d99170d978"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d6e54a77d2aa469b8c0197d99170d978", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d6e54a77d2aa469b8c0197d99170d978"}]}] Jul 28 05:38:55.445832 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant: tempest-AttachVolumeShelveTestJSON-524079106 Jul 28 05:38:55.445832 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Id: d6e54a77d2aa469b8c0197d99170d978 Jul 28 05:38:55.445832 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-524079106 Jul 28 05:38:55.445832 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User: tempest-AttachVolumeShelveTestJSON-524079106-project Jul 28 05:38:55.445832 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Id: default Jul 28 05:38:55.445832 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Name: Default Jul 28 05:38:55.445832 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Id: 22fddcc9952a459899e48a93d1d962db Jul 28 05:38:55.445832 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Name: tempest-AttachVolumeShelveTestJSON-524079106-project Jul 28 05:38:55.445832 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: method: > Jul 28 05:38:55.445832 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: exception: Instance 54986322-1272-4f12-a108-b8675f3190a6 could not be found. Jul 28 05:38:55.445832 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: action_args: {'id': '54986322-1272-4f12-a108-b8675f3190a6'} Jul 28 05:38:55.446639 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 05:38:55.446639 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:38:55.446639 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 05:38:55.446639 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 05:38:55.446639 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 05:38:55.446639 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 05:38:55.446639 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 05:38:55.446639 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 05:38:55.446639 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 05:38:55.446639 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 05:38:55.446639 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54986322-1272-4f12-a108-b8675f3190a6 could not be found. Jul 28 05:38:55.446639 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:55.446639 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:38:55.446639 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:55.446639 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:38:55.446639 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:38:55.446639 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:38:55.446639 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 05:38:55.446639 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 05:38:55.446639 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 05:38:55.447798 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:38:55.447798 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 05:38:55.447798 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 05:38:55.447798 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 05:38:55.447798 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 05:38:55.447798 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 05:38:55.447798 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 05:38:55.447798 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54986322-1272-4f12-a108-b8675f3190a6 could not be found. Jul 28 05:38:55.447798 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:55.447798 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:38:55.447798 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:55.447798 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:38:55.447798 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:38:55.447798 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:38:55.447798 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 05:38:55.447798 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 05:38:55.447798 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54986322-1272-4f12-a108-b8675f3190a6 could not be found. Jul 28 05:38:55.447798 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:55.448871 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-c96b4d79-39a7-4a61-a1ba-eea318c27c9e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Returning 404 to user: Instance 54986322-1272-4f12-a108-b8675f3190a6 could not be found. {{(pid=124482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 05:38:55.448871 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-c96b4d79-39a7-4a61-a1ba-eea318c27c9e tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 404 len: 111 microversion: 2.20 time: 0.050027 Jul 28 05:38:55.451109 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 686/910] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:38:55 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 05:38:55.457028 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-023f350c-b236-4df0-b2ec-a83096d30569 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '.version_select at 0x7f25e4c3f0d0>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:55.553333 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-023f350c-b236-4df0-b2ec-a83096d30569 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-867176790" status: 204 len: 0 microversion: 2.20 time: 0.100398 Jul 28 05:38:55.554151 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 687/911] 10.222.0.33 () {60 vars in 1259 bytes} [Thu Jul 28 05:38:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-867176790 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 05:38:58.128881 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-5b14eb06-ea2f-44c4-be12-8c172bc70931 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:58.130096 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-5b14eb06-ea2f-44c4-be12-8c172bc70931 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:58.136965 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5b14eb06-ea2f-44c4-be12-8c172bc70931 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:58.137419 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5b14eb06-ea2f-44c4-be12-8c172bc70931 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:58.138229 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5b14eb06-ea2f-44c4-be12-8c172bc70931 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:58.138730 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5b14eb06-ea2f-44c4-be12-8c172bc70931 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:58.151770 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.wsgi [None req-5b14eb06-ea2f-44c4-be12-8c172bc70931 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] HTTP exception thrown: Instance 54986322-1272-4f12-a108-b8675f3190a6 could not be found. Jul 28 05:38:58.153303 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-5b14eb06-ea2f-44c4-be12-8c172bc70931 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Request method failure captured: Jul 28 05:38:58.153303 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: request: DELETE /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 HTTP/1.1 Jul 28 05:38:58.153303 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept: application/json Jul 28 05:38:58.153303 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept-Encoding: identity Jul 28 05:38:58.153303 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Connection: close Jul 28 05:38:58.153303 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Length: 0 Jul 28 05:38:58.153303 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Type: application/json Jul 28 05:38:58.153303 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Host: 10.222.0.33 Jul 28 05:38:58.153303 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Openstack-System-Scope: None Jul 28 05:38:58.153303 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: User-Agent: python-urllib3/1.26.10 Jul 28 05:38:58.153303 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Auth-Token: gAAAAABi4h9B4BZ0YKk62IEiK2B7fNXnAEvmUzwRuX3HZAwpyBQuwrelM32kVXxMwMHFWRpIiF0wrQELj7IIFkWW2dNQ1l6hVjctg_7QgVgoHpLuzx0PaLQ7DgaTnloBovVfWeMHK4qw8EQUGTonIgEEe8nVn-xX6wXcJIqTwy53KhNB8eAmkus Jul 28 05:38:58.153303 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Id: None Jul 28 05:38:58.153303 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Name: None Jul 28 05:38:58.153303 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Identity-Status: Confirmed Jul 28 05:38:58.153303 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Is-Admin-Project: True Jul 28 05:38:58.153303 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 05:38:58.153303 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Id: default Jul 28 05:38:58.153303 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Name: Default Jul 28 05:38:58.153303 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Id: d6e54a77d2aa469b8c0197d99170d978 Jul 28 05:38:58.153303 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-524079106 Jul 28 05:38:58.153303 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Role: member,reader Jul 28 05:38:58.153303 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Roles: member,reader Jul 28 05:38:58.154932 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d6e54a77d2aa469b8c0197d99170d978"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d6e54a77d2aa469b8c0197d99170d978"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d6e54a77d2aa469b8c0197d99170d978", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d6e54a77d2aa469b8c0197d99170d978"}]}] Jul 28 05:38:58.154932 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant: tempest-AttachVolumeShelveTestJSON-524079106 Jul 28 05:38:58.154932 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Id: d6e54a77d2aa469b8c0197d99170d978 Jul 28 05:38:58.154932 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-524079106 Jul 28 05:38:58.154932 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User: tempest-AttachVolumeShelveTestJSON-524079106-project Jul 28 05:38:58.154932 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Id: default Jul 28 05:38:58.154932 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Name: Default Jul 28 05:38:58.154932 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Id: 22fddcc9952a459899e48a93d1d962db Jul 28 05:38:58.154932 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Name: tempest-AttachVolumeShelveTestJSON-524079106-project Jul 28 05:38:58.154932 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: method: > Jul 28 05:38:58.154932 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: exception: Instance 54986322-1272-4f12-a108-b8675f3190a6 could not be found. Jul 28 05:38:58.154932 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: action_args: {'id': '54986322-1272-4f12-a108-b8675f3190a6'} Jul 28 05:38:58.155833 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 05:38:58.155833 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:38:58.155833 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 05:38:58.155833 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 05:38:58.155833 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 05:38:58.155833 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 05:38:58.155833 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 05:38:58.155833 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 05:38:58.155833 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 05:38:58.155833 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 05:38:58.155833 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54986322-1272-4f12-a108-b8675f3190a6 could not be found. Jul 28 05:38:58.155833 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:58.155833 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:38:58.155833 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:58.155833 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:38:58.155833 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:38:58.155833 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:38:58.155833 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 05:38:58.155833 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 05:38:58.155833 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 05:38:58.157361 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:38:58.157361 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 05:38:58.157361 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 05:38:58.157361 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 05:38:58.157361 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 05:38:58.157361 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 05:38:58.157361 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 05:38:58.157361 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 05:38:58.157361 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 05:38:58.157361 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54986322-1272-4f12-a108-b8675f3190a6 could not be found. Jul 28 05:38:58.157361 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:58.157361 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:38:58.157361 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:58.157361 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:38:58.157361 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:38:58.157361 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:38:58.157361 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 05:38:58.157361 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 05:38:58.157361 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54986322-1272-4f12-a108-b8675f3190a6 could not be found. Jul 28 05:38:58.157361 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:58.159537 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-5b14eb06-ea2f-44c4-be12-8c172bc70931 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Returning 404 to user: Instance 54986322-1272-4f12-a108-b8675f3190a6 could not be found. {{(pid=124482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 05:38:58.159537 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-5b14eb06-ea2f-44c4-be12-8c172bc70931 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "DELETE /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 404 len: 111 microversion: 2.20 time: 0.030581 Jul 28 05:38:58.159537 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 688/912] 10.222.0.33 () {60 vars in 1280 bytes} [Thu Jul 28 05:38:58 2022] DELETE /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 28 05:38:58.163804 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-ed7fc298-88fe-46ec-b730-91723b9caa8f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:58.164406 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-ed7fc298-88fe-46ec-b730-91723b9caa8f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 54986322-1272-4f12-a108-b8675f3190a6] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:58.170241 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ed7fc298-88fe-46ec-b730-91723b9caa8f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:58.170689 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ed7fc298-88fe-46ec-b730-91723b9caa8f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:58.171441 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ed7fc298-88fe-46ec-b730-91723b9caa8f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:58.171900 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ed7fc298-88fe-46ec-b730-91723b9caa8f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:58.185761 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.wsgi [None req-ed7fc298-88fe-46ec-b730-91723b9caa8f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] HTTP exception thrown: Instance 54986322-1272-4f12-a108-b8675f3190a6 could not be found. Jul 28 05:38:58.187269 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-ed7fc298-88fe-46ec-b730-91723b9caa8f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Request method failure captured: Jul 28 05:38:58.187269 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: request: GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 HTTP/1.1 Jul 28 05:38:58.187269 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept: application/json Jul 28 05:38:58.187269 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept-Encoding: identity Jul 28 05:38:58.187269 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Connection: close Jul 28 05:38:58.187269 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Length: 0 Jul 28 05:38:58.187269 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Type: application/json Jul 28 05:38:58.187269 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Host: 10.222.0.33 Jul 28 05:38:58.187269 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Openstack-System-Scope: None Jul 28 05:38:58.187269 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: User-Agent: python-urllib3/1.26.10 Jul 28 05:38:58.187269 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Auth-Token: gAAAAABi4h9B4BZ0YKk62IEiK2B7fNXnAEvmUzwRuX3HZAwpyBQuwrelM32kVXxMwMHFWRpIiF0wrQELj7IIFkWW2dNQ1l6hVjctg_7QgVgoHpLuzx0PaLQ7DgaTnloBovVfWeMHK4qw8EQUGTonIgEEe8nVn-xX6wXcJIqTwy53KhNB8eAmkus Jul 28 05:38:58.187269 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Id: None Jul 28 05:38:58.187269 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Name: None Jul 28 05:38:58.187269 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Identity-Status: Confirmed Jul 28 05:38:58.187269 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Is-Admin-Project: True Jul 28 05:38:58.187269 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 05:38:58.187269 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Id: default Jul 28 05:38:58.187269 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Name: Default Jul 28 05:38:58.187269 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Id: d6e54a77d2aa469b8c0197d99170d978 Jul 28 05:38:58.187269 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-524079106 Jul 28 05:38:58.187269 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Role: member,reader Jul 28 05:38:58.187269 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Roles: member,reader Jul 28 05:38:58.188848 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d6e54a77d2aa469b8c0197d99170d978"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d6e54a77d2aa469b8c0197d99170d978"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d6e54a77d2aa469b8c0197d99170d978", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d6e54a77d2aa469b8c0197d99170d978"}]}] Jul 28 05:38:58.188848 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant: tempest-AttachVolumeShelveTestJSON-524079106 Jul 28 05:38:58.188848 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Id: d6e54a77d2aa469b8c0197d99170d978 Jul 28 05:38:58.188848 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-524079106 Jul 28 05:38:58.188848 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User: tempest-AttachVolumeShelveTestJSON-524079106-project Jul 28 05:38:58.188848 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Id: default Jul 28 05:38:58.188848 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Name: Default Jul 28 05:38:58.188848 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Id: 22fddcc9952a459899e48a93d1d962db Jul 28 05:38:58.188848 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Name: tempest-AttachVolumeShelveTestJSON-524079106-project Jul 28 05:38:58.188848 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: method: > Jul 28 05:38:58.188848 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: exception: Instance 54986322-1272-4f12-a108-b8675f3190a6 could not be found. Jul 28 05:38:58.188848 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: action_args: {'id': '54986322-1272-4f12-a108-b8675f3190a6'} Jul 28 05:38:58.189888 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 05:38:58.189888 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:38:58.189888 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 05:38:58.189888 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 05:38:58.189888 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 05:38:58.189888 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 05:38:58.189888 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 05:38:58.189888 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 05:38:58.189888 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 05:38:58.189888 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 05:38:58.189888 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54986322-1272-4f12-a108-b8675f3190a6 could not be found. Jul 28 05:38:58.189888 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:58.189888 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:38:58.189888 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:58.189888 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:38:58.189888 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:38:58.189888 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:38:58.189888 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 05:38:58.189888 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 05:38:58.189888 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 05:38:58.192131 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:38:58.192131 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 05:38:58.192131 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 05:38:58.192131 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 05:38:58.192131 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 05:38:58.192131 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 05:38:58.192131 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 05:38:58.192131 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54986322-1272-4f12-a108-b8675f3190a6 could not be found. Jul 28 05:38:58.192131 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:58.192131 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:38:58.192131 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:58.192131 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:38:58.192131 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:38:58.192131 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:38:58.192131 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 05:38:58.192131 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 05:38:58.192131 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54986322-1272-4f12-a108-b8675f3190a6 could not be found. Jul 28 05:38:58.192131 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:58.193603 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-ed7fc298-88fe-46ec-b730-91723b9caa8f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Returning 404 to user: Instance 54986322-1272-4f12-a108-b8675f3190a6 could not be found. {{(pid=124482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 05:38:58.193603 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-ed7fc298-88fe-46ec-b730-91723b9caa8f tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6" status: 404 len: 111 microversion: 2.20 time: 0.028793 Jul 28 05:38:58.193603 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 689/913] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:38:58 2022] GET /compute/v2.1/servers/54986322-1272-4f12-a108-b8675f3190a6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 28 05:38:59.496084 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-570676e4-68f5-4a4b-b4a8-2d0a838259ea tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:59.496731 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-570676e4-68f5-4a4b-b4a8-2d0a838259ea tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:59.504125 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-570676e4-68f5-4a4b-b4a8-2d0a838259ea tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:59.504916 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-570676e4-68f5-4a4b-b4a8-2d0a838259ea tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:59.505887 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-570676e4-68f5-4a4b-b4a8-2d0a838259ea tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:59.506477 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-570676e4-68f5-4a4b-b4a8-2d0a838259ea tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:59.527018 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.wsgi [None req-570676e4-68f5-4a4b-b4a8-2d0a838259ea tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] HTTP exception thrown: Instance 57115a26-af82-499e-a831-4b4c40e60ac5 could not be found. Jul 28 05:38:59.527018 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-570676e4-68f5-4a4b-b4a8-2d0a838259ea tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Request method failure captured: Jul 28 05:38:59.527018 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: request: DELETE /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 HTTP/1.1 Jul 28 05:38:59.527018 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept: application/json Jul 28 05:38:59.527018 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept-Encoding: identity Jul 28 05:38:59.527018 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Connection: close Jul 28 05:38:59.527018 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Length: 0 Jul 28 05:38:59.527018 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Type: application/json Jul 28 05:38:59.527018 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Host: 10.222.0.33 Jul 28 05:38:59.527018 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Openstack-System-Scope: None Jul 28 05:38:59.527018 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: User-Agent: python-urllib3/1.26.10 Jul 28 05:38:59.527018 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Auth-Token: gAAAAABi4h9B4BZ0YKk62IEiK2B7fNXnAEvmUzwRuX3HZAwpyBQuwrelM32kVXxMwMHFWRpIiF0wrQELj7IIFkWW2dNQ1l6hVjctg_7QgVgoHpLuzx0PaLQ7DgaTnloBovVfWeMHK4qw8EQUGTonIgEEe8nVn-xX6wXcJIqTwy53KhNB8eAmkus Jul 28 05:38:59.527018 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Id: None Jul 28 05:38:59.527018 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Name: None Jul 28 05:38:59.527018 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Identity-Status: Confirmed Jul 28 05:38:59.527018 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Is-Admin-Project: True Jul 28 05:38:59.527018 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 05:38:59.527018 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Id: default Jul 28 05:38:59.527018 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Name: Default Jul 28 05:38:59.527018 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Id: d6e54a77d2aa469b8c0197d99170d978 Jul 28 05:38:59.527018 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-524079106 Jul 28 05:38:59.527018 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Role: member,reader Jul 28 05:38:59.527018 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Roles: member,reader Jul 28 05:38:59.528703 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d6e54a77d2aa469b8c0197d99170d978"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d6e54a77d2aa469b8c0197d99170d978"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d6e54a77d2aa469b8c0197d99170d978", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d6e54a77d2aa469b8c0197d99170d978"}]}] Jul 28 05:38:59.528703 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant: tempest-AttachVolumeShelveTestJSON-524079106 Jul 28 05:38:59.528703 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Id: d6e54a77d2aa469b8c0197d99170d978 Jul 28 05:38:59.528703 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-524079106 Jul 28 05:38:59.528703 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User: tempest-AttachVolumeShelveTestJSON-524079106-project Jul 28 05:38:59.528703 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Id: default Jul 28 05:38:59.528703 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Name: Default Jul 28 05:38:59.528703 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Id: 22fddcc9952a459899e48a93d1d962db Jul 28 05:38:59.528703 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Name: tempest-AttachVolumeShelveTestJSON-524079106-project Jul 28 05:38:59.528703 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: method: > Jul 28 05:38:59.528703 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: exception: Instance 57115a26-af82-499e-a831-4b4c40e60ac5 could not be found. Jul 28 05:38:59.528703 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: action_args: {'id': '57115a26-af82-499e-a831-4b4c40e60ac5'} Jul 28 05:38:59.529682 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 05:38:59.529682 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:38:59.529682 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 05:38:59.529682 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 05:38:59.529682 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 05:38:59.529682 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 05:38:59.529682 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 05:38:59.529682 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 05:38:59.529682 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 05:38:59.529682 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 05:38:59.529682 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57115a26-af82-499e-a831-4b4c40e60ac5 could not be found. Jul 28 05:38:59.529682 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:59.529682 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:38:59.529682 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:59.529682 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:38:59.529682 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:38:59.529682 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:38:59.529682 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 05:38:59.529682 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 05:38:59.529682 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 05:38:59.530827 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:38:59.530827 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 05:38:59.530827 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 05:38:59.530827 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 05:38:59.530827 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 05:38:59.530827 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 05:38:59.530827 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 05:38:59.530827 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 05:38:59.530827 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 05:38:59.530827 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57115a26-af82-499e-a831-4b4c40e60ac5 could not be found. Jul 28 05:38:59.530827 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:59.530827 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:38:59.530827 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:59.530827 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:38:59.530827 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:38:59.530827 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:38:59.530827 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 05:38:59.530827 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 05:38:59.530827 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57115a26-af82-499e-a831-4b4c40e60ac5 could not be found. Jul 28 05:38:59.530827 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:59.531980 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-570676e4-68f5-4a4b-b4a8-2d0a838259ea tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Returning 404 to user: Instance 57115a26-af82-499e-a831-4b4c40e60ac5 could not be found. {{(pid=124482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 05:38:59.531980 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-570676e4-68f5-4a4b-b4a8-2d0a838259ea tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "DELETE /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 404 len: 111 microversion: 2.20 time: 0.031656 Jul 28 05:38:59.531980 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 690/914] 10.222.0.33 () {60 vars in 1280 bytes} [Thu Jul 28 05:38:59 2022] DELETE /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 28 05:38:59.534106 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-b17ac19c-9034-44fe-8762-ef6ddd938e69 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:38:59.534726 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-b17ac19c-9034-44fe-8762-ef6ddd938e69 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] [instance: 57115a26-af82-499e-a831-4b4c40e60ac5] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:38:59.540621 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b17ac19c-9034-44fe-8762-ef6ddd938e69 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:59.541072 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b17ac19c-9034-44fe-8762-ef6ddd938e69 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:59.541864 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b17ac19c-9034-44fe-8762-ef6ddd938e69 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:38:59.542329 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b17ac19c-9034-44fe-8762-ef6ddd938e69 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:38:59.556094 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.wsgi [None req-b17ac19c-9034-44fe-8762-ef6ddd938e69 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] HTTP exception thrown: Instance 57115a26-af82-499e-a831-4b4c40e60ac5 could not be found. Jul 28 05:38:59.557612 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-b17ac19c-9034-44fe-8762-ef6ddd938e69 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Request method failure captured: Jul 28 05:38:59.557612 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: request: GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 HTTP/1.1 Jul 28 05:38:59.557612 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept: application/json Jul 28 05:38:59.557612 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept-Encoding: identity Jul 28 05:38:59.557612 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Connection: close Jul 28 05:38:59.557612 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Length: 0 Jul 28 05:38:59.557612 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Type: application/json Jul 28 05:38:59.557612 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Host: 10.222.0.33 Jul 28 05:38:59.557612 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Openstack-System-Scope: None Jul 28 05:38:59.557612 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: User-Agent: python-urllib3/1.26.10 Jul 28 05:38:59.557612 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Auth-Token: gAAAAABi4h9B4BZ0YKk62IEiK2B7fNXnAEvmUzwRuX3HZAwpyBQuwrelM32kVXxMwMHFWRpIiF0wrQELj7IIFkWW2dNQ1l6hVjctg_7QgVgoHpLuzx0PaLQ7DgaTnloBovVfWeMHK4qw8EQUGTonIgEEe8nVn-xX6wXcJIqTwy53KhNB8eAmkus Jul 28 05:38:59.557612 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Id: None Jul 28 05:38:59.557612 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Name: None Jul 28 05:38:59.557612 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Identity-Status: Confirmed Jul 28 05:38:59.557612 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Is-Admin-Project: True Jul 28 05:38:59.557612 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 05:38:59.557612 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Id: default Jul 28 05:38:59.557612 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Name: Default Jul 28 05:38:59.557612 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Id: d6e54a77d2aa469b8c0197d99170d978 Jul 28 05:38:59.557612 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-524079106 Jul 28 05:38:59.557612 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Role: member,reader Jul 28 05:38:59.557612 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Roles: member,reader Jul 28 05:38:59.564128 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d6e54a77d2aa469b8c0197d99170d978"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d6e54a77d2aa469b8c0197d99170d978"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d6e54a77d2aa469b8c0197d99170d978", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d6e54a77d2aa469b8c0197d99170d978"}]}] Jul 28 05:38:59.564128 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant: tempest-AttachVolumeShelveTestJSON-524079106 Jul 28 05:38:59.564128 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Id: d6e54a77d2aa469b8c0197d99170d978 Jul 28 05:38:59.564128 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-524079106 Jul 28 05:38:59.564128 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User: tempest-AttachVolumeShelveTestJSON-524079106-project Jul 28 05:38:59.564128 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Id: default Jul 28 05:38:59.564128 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Name: Default Jul 28 05:38:59.564128 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Id: 22fddcc9952a459899e48a93d1d962db Jul 28 05:38:59.564128 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Name: tempest-AttachVolumeShelveTestJSON-524079106-project Jul 28 05:38:59.564128 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: method: > Jul 28 05:38:59.564128 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: exception: Instance 57115a26-af82-499e-a831-4b4c40e60ac5 could not be found. Jul 28 05:38:59.564128 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: action_args: {'id': '57115a26-af82-499e-a831-4b4c40e60ac5'} Jul 28 05:38:59.566197 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 05:38:59.566197 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:38:59.566197 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 05:38:59.566197 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 05:38:59.566197 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 05:38:59.566197 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 05:38:59.566197 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 05:38:59.566197 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 05:38:59.566197 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 05:38:59.566197 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 05:38:59.566197 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57115a26-af82-499e-a831-4b4c40e60ac5 could not be found. Jul 28 05:38:59.566197 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:59.566197 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:38:59.566197 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:59.566197 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:38:59.566197 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:38:59.566197 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:38:59.566197 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 05:38:59.566197 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 05:38:59.566197 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 05:38:59.567860 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:38:59.567860 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 05:38:59.567860 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 05:38:59.567860 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 05:38:59.567860 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 05:38:59.567860 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 05:38:59.567860 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 05:38:59.567860 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57115a26-af82-499e-a831-4b4c40e60ac5 could not be found. Jul 28 05:38:59.567860 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:59.567860 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:38:59.567860 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:59.567860 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:38:59.567860 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:38:59.567860 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:38:59.567860 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 05:38:59.567860 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 05:38:59.567860 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57115a26-af82-499e-a831-4b4c40e60ac5 could not be found. Jul 28 05:38:59.567860 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:38:59.569135 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-b17ac19c-9034-44fe-8762-ef6ddd938e69 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] Returning 404 to user: Instance 57115a26-af82-499e-a831-4b4c40e60ac5 could not be found. {{(pid=124482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 05:38:59.569135 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-b17ac19c-9034-44fe-8762-ef6ddd938e69 tempest-AttachVolumeShelveTestJSON-524079106 tempest-AttachVolumeShelveTestJSON-524079106-project] 10.222.0.33 "GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5" status: 404 len: 111 microversion: 2.20 time: 0.028910 Jul 28 05:38:59.569135 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 691/915] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jul 28 05:38:59 2022] GET /compute/v2.1/servers/57115a26-af82-499e-a831-4b4c40e60ac5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 28 05:39:01.935877 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-fa204c0b-2ef5-4292-b845-c861ba46f088 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1541881698"}} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:39:01.936563 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-fa204c0b-2ef5-4292-b845-c861ba46f088 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] [instance: 549e692f-7b6f-4ab0-987b-986a1934630e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:39:01.943951 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-fa204c0b-2ef5-4292-b845-c861ba46f088 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:39:01.944399 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-fa204c0b-2ef5-4292-b845-c861ba46f088 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:39:01.945324 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-fa204c0b-2ef5-4292-b845-c861ba46f088 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:39:01.945792 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-fa204c0b-2ef5-4292-b845-c861ba46f088 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:39:02.165544 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.network.security_group_api [None req-fa204c0b-2ef5-4292-b845-c861ba46f088 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Removing security group 67629efd-defe-468a-8cc4-0b3911b29ce3 from port b49100c3-29f8-45db-910f-805da59e6250 Jul 28 05:39:02.734406 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-fa204c0b-2ef5-4292-b845-c861ba46f088 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] 10.222.0.33 "POST /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e/action" status: 202 len: 0 microversion: 2.1 time: 0.802456 Jul 28 05:39:02.739535 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 692/916] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Jul 28 05:39:01 2022] POST /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e/action => generated 0 bytes in 804 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 05:39:02.748447 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-9fa40230-5f11-408a-bc86-b78ce77142ed req-d67702b8-8283-4909-9eb5-df8f402e21d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "549e692f-7b6f-4ab0-987b-986a1934630e", "tag": "b49100c3-29f8-45db-910f-805da59e6250"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:39:02.767057 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-9fa40230-5f11-408a-bc86-b78ce77142ed req-d67702b8-8283-4909-9eb5-df8f402e21d8 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:39:02.767224 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-9fa40230-5f11-408a-bc86-b78ce77142ed req-d67702b8-8283-4909-9eb5-df8f402e21d8 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:39:02.782898 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-9fa40230-5f11-408a-bc86-b78ce77142ed req-d67702b8-8283-4909-9eb5-df8f402e21d8 service nova] Creating event network-changed:b49100c3-29f8-45db-910f-805da59e6250 for instance 549e692f-7b6f-4ab0-987b-986a1934630e on hv-cinder-79987 Jul 28 05:39:02.794005 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-9fa40230-5f11-408a-bc86-b78ce77142ed req-d67702b8-8283-4909-9eb5-df8f402e21d8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044884 Jul 28 05:39:02.794005 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 693/917] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:39:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 05:39:05.069343 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-459cf594-b874-4a30-bfff-287f4010eeb8 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:39:05.070837 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-459cf594-b874-4a30-bfff-287f4010eeb8 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] [instance: 549e692f-7b6f-4ab0-987b-986a1934630e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:39:05.079045 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-459cf594-b874-4a30-bfff-287f4010eeb8 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:39:05.079869 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-459cf594-b874-4a30-bfff-287f4010eeb8 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:39:05.081428 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-459cf594-b874-4a30-bfff-287f4010eeb8 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:39:05.082106 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-459cf594-b874-4a30-bfff-287f4010eeb8 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:39:05.196149 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.objects.instance [None req-459cf594-b874-4a30-bfff-287f4010eeb8 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lazy-loading 'services' on Instance uuid 549e692f-7b6f-4ab0-987b-986a1934630e {{(pid=124482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 05:39:05.461220 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-459cf594-b874-4a30-bfff-287f4010eeb8 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] 10.222.0.33 "DELETE /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e/os-volume_attachments/fda1b7f1-0963-4d37-befe-efcb6f58f83c" status: 202 len: 0 microversion: 2.1 time: 0.399451 Jul 28 05:39:05.462182 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 694/918] 10.222.0.33 () {58 vars in 1416 bytes} [Thu Jul 28 05:39:05 2022] DELETE /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e/os-volume_attachments/fda1b7f1-0963-4d37-befe-efcb6f58f83c => generated 0 bytes in 402 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 05:39:05.467377 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-3fd43f64-db52-49ff-b6e1-8da635c43e89 req-7720ae26-0c57-46c4-9119-d85b1658a479 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "549e692f-7b6f-4ab0-987b-986a1934630e", "tag": "b49100c3-29f8-45db-910f-805da59e6250"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:39:05.479403 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-3fd43f64-db52-49ff-b6e1-8da635c43e89 req-7720ae26-0c57-46c4-9119-d85b1658a479 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:39:05.480134 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-3fd43f64-db52-49ff-b6e1-8da635c43e89 req-7720ae26-0c57-46c4-9119-d85b1658a479 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:39:05.492084 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-3fd43f64-db52-49ff-b6e1-8da635c43e89 req-7720ae26-0c57-46c4-9119-d85b1658a479 service nova] Creating event network-changed:b49100c3-29f8-45db-910f-805da59e6250 for instance 549e692f-7b6f-4ab0-987b-986a1934630e on hv-cinder-79987 Jul 28 05:39:05.498009 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-3fd43f64-db52-49ff-b6e1-8da635c43e89 req-7720ae26-0c57-46c4-9119-d85b1658a479 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034312 Jul 28 05:39:05.498835 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 695/919] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:39:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:39:05.505777 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-c9300976-db57-427f-87a0-5a000d65d1b7 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:39:05.508262 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-c9300976-db57-427f-87a0-5a000d65d1b7 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] [instance: 549e692f-7b6f-4ab0-987b-986a1934630e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:39:05.517755 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c9300976-db57-427f-87a0-5a000d65d1b7 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:39:05.519218 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c9300976-db57-427f-87a0-5a000d65d1b7 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:39:05.520229 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c9300976-db57-427f-87a0-5a000d65d1b7 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:39:05.521038 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c9300976-db57-427f-87a0-5a000d65d1b7 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:39:05.578045 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-c9300976-db57-427f-87a0-5a000d65d1b7 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] 10.222.0.33 "GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077687 Jul 28 05:39:05.584072 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 696/920] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Jul 28 05:39:05 2022] GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:39:06.591353 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-8079ac23-ff13-403d-9903-d53fe2abc834 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:39:06.593656 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-8079ac23-ff13-403d-9903-d53fe2abc834 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] [instance: 549e692f-7b6f-4ab0-987b-986a1934630e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:39:06.603336 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8079ac23-ff13-403d-9903-d53fe2abc834 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:39:06.603856 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8079ac23-ff13-403d-9903-d53fe2abc834 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:39:06.604756 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8079ac23-ff13-403d-9903-d53fe2abc834 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:39:06.605218 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8079ac23-ff13-403d-9903-d53fe2abc834 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:39:06.637014 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-8079ac23-ff13-403d-9903-d53fe2abc834 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] 10.222.0.33 "GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049607 Jul 28 05:39:06.637816 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 697/921] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Jul 28 05:39:06 2022] GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 05:39:07.653215 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-47c55720-bc8a-4447-a111-6140a68a6ad1 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:39:07.655039 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-47c55720-bc8a-4447-a111-6140a68a6ad1 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] [instance: 549e692f-7b6f-4ab0-987b-986a1934630e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:39:07.662282 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-47c55720-bc8a-4447-a111-6140a68a6ad1 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:39:07.662843 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-47c55720-bc8a-4447-a111-6140a68a6ad1 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:39:07.663764 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-47c55720-bc8a-4447-a111-6140a68a6ad1 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:39:07.664255 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-47c55720-bc8a-4447-a111-6140a68a6ad1 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:39:07.701034 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-47c55720-bc8a-4447-a111-6140a68a6ad1 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] 10.222.0.33 "GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054526 Jul 28 05:39:07.701771 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 698/922] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Jul 28 05:39:07 2022] GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 05:39:07.716287 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-103a591f-379f-4fdb-9ea2-12e774a899f7 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:39:07.716287 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-103a591f-379f-4fdb-9ea2-12e774a899f7 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] [instance: 549e692f-7b6f-4ab0-987b-986a1934630e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:39:07.719053 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-103a591f-379f-4fdb-9ea2-12e774a899f7 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:39:07.719517 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-103a591f-379f-4fdb-9ea2-12e774a899f7 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:39:07.720280 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-103a591f-379f-4fdb-9ea2-12e774a899f7 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:39:07.720886 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-103a591f-379f-4fdb-9ea2-12e774a899f7 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:39:07.797999 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.wsgi [None req-103a591f-379f-4fdb-9ea2-12e774a899f7 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] HTTP exception thrown: Instance 549e692f-7b6f-4ab0-987b-986a1934630e is not attached to volume fda1b7f1-0963-4d37-befe-efcb6f58f83c Jul 28 05:39:07.810761 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-103a591f-379f-4fdb-9ea2-12e774a899f7 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Request method failure captured: Jul 28 05:39:07.810761 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: request: DELETE /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e/os-volume_attachments/fda1b7f1-0963-4d37-befe-efcb6f58f83c HTTP/1.1 Jul 28 05:39:07.810761 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept: application/json Jul 28 05:39:07.810761 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept-Encoding: identity Jul 28 05:39:07.810761 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Connection: close Jul 28 05:39:07.810761 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Length: 0 Jul 28 05:39:07.810761 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Type: application/json Jul 28 05:39:07.810761 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Host: 10.222.0.33 Jul 28 05:39:07.810761 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Openstack-System-Scope: None Jul 28 05:39:07.810761 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: User-Agent: python-urllib3/1.26.10 Jul 28 05:39:07.810761 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Auth-Token: gAAAAABi4iBY8mdy966V2dGqyfw-f7QDQ6gspKAM-ufUe8kNzCCBJ3C7E8-bdJqpCi7sOwxLWqMJQjpkDvcTYf5AsubGcgQRq-hwIz3qX1nX_xK2vwMfMvfbCZ5UUYVvkLxRjLFdDGqxl4A0RdXEJLIWYs5Bva_GsXuYNatLTBSrbHA_3vrAMek Jul 28 05:39:07.810761 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Id: None Jul 28 05:39:07.810761 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Name: None Jul 28 05:39:07.810761 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Identity-Status: Confirmed Jul 28 05:39:07.810761 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Is-Admin-Project: True Jul 28 05:39:07.810761 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Id: default Jul 28 05:39:07.810761 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Name: Default Jul 28 05:39:07.810761 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Id: 5989fabc615545eeb4ef987dea566175 Jul 28 05:39:07.810761 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Name: tempest-TestMinimumBasicScenario-838793625 Jul 28 05:39:07.810761 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Role: member,reader Jul 28 05:39:07.810761 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Roles: member,reader Jul 28 05:39:07.812350 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5989fabc615545eeb4ef987dea566175"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5989fabc615545eeb4ef987dea566175"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5989fabc615545eeb4ef987dea566175", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5989fabc615545eeb4ef987dea566175"}]}] Jul 28 05:39:07.812350 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant: tempest-TestMinimumBasicScenario-838793625 Jul 28 05:39:07.812350 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Id: 5989fabc615545eeb4ef987dea566175 Jul 28 05:39:07.812350 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Name: tempest-TestMinimumBasicScenario-838793625 Jul 28 05:39:07.812350 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User: tempest-TestMinimumBasicScenario-838793625-project Jul 28 05:39:07.812350 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Id: default Jul 28 05:39:07.812350 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Name: Default Jul 28 05:39:07.812350 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Id: 7d859e797d874c948325f2ce0978edb6 Jul 28 05:39:07.812350 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Name: tempest-TestMinimumBasicScenario-838793625-project Jul 28 05:39:07.812350 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: method: > Jul 28 05:39:07.812350 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: exception: Instance 549e692f-7b6f-4ab0-987b-986a1934630e is not attached to volume fda1b7f1-0963-4d37-befe-efcb6f58f83c Jul 28 05:39:07.813277 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: action_args: {'server_id': '549e692f-7b6f-4ab0-987b-986a1934630e', 'id': 'fda1b7f1-0963-4d37-befe-efcb6f58f83c'} Jul 28 05:39:07.813277 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 05:39:07.813277 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:39:07.813277 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 28 05:39:07.813277 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 28 05:39:07.813277 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 05:39:07.813277 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 05:39:07.813277 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 28 05:39:07.813277 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 28 05:39:07.813277 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id fda1b7f1-0963-4d37-befe-efcb6f58f83c. Jul 28 05:39:07.813277 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:39:07.813277 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:39:07.813277 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:39:07.813277 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:39:07.813277 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:39:07.813277 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:39:07.813277 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 05:39:07.813277 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 05:39:07.813277 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 05:39:07.814811 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:39:07.814811 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 28 05:39:07.814811 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 28 05:39:07.814811 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 549e692f-7b6f-4ab0-987b-986a1934630e is not attached to volume fda1b7f1-0963-4d37-befe-efcb6f58f83c Jul 28 05:39:07.814811 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:39:07.814811 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:39:07.814811 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:39:07.814811 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:39:07.814811 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:39:07.814811 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:39:07.814811 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 05:39:07.814811 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 05:39:07.814811 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 549e692f-7b6f-4ab0-987b-986a1934630e is not attached to volume fda1b7f1-0963-4d37-befe-efcb6f58f83c Jul 28 05:39:07.814811 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:39:07.814811 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-103a591f-379f-4fdb-9ea2-12e774a899f7 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Returning 404 to user: Instance 549e692f-7b6f-4ab0-987b-986a1934630e is not attached to volume fda1b7f1-0963-4d37-befe-efcb6f58f83c {{(pid=124482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 05:39:07.816704 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-103a591f-379f-4fdb-9ea2-12e774a899f7 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] 10.222.0.33 "DELETE /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e/os-volume_attachments/fda1b7f1-0963-4d37-befe-efcb6f58f83c" status: 404 len: 154 microversion: 2.1 time: 0.104391 Jul 28 05:39:07.816704 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 699/923] 10.222.0.33 () {58 vars in 1416 bytes} [Thu Jul 28 05:39:07 2022] DELETE /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e/os-volume_attachments/fda1b7f1-0963-4d37-befe-efcb6f58f83c => generated 154 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 05:39:09.160974 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-62097ed5-35f5-471c-8c8c-4a963e7ad72d tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:39:09.160974 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-62097ed5-35f5-471c-8c8c-4a963e7ad72d tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] [instance: 549e692f-7b6f-4ab0-987b-986a1934630e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:39:09.172333 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-62097ed5-35f5-471c-8c8c-4a963e7ad72d tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:39:09.172786 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-62097ed5-35f5-471c-8c8c-4a963e7ad72d tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:39:09.173606 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-62097ed5-35f5-471c-8c8c-4a963e7ad72d tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:39:09.174030 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-62097ed5-35f5-471c-8c8c-4a963e7ad72d tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:39:09.210675 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-62097ed5-35f5-471c-8c8c-4a963e7ad72d tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] [instance: 549e692f-7b6f-4ab0-987b-986a1934630e] Going to try to terminate instance {{(pid=124482) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 05:39:09.571542 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-62097ed5-35f5-471c-8c8c-4a963e7ad72d tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] 10.222.0.33 "DELETE /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e" status: 204 len: 0 microversion: 2.1 time: 0.415051 Jul 28 05:39:09.576388 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 700/924] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Jul 28 05:39:09 2022] DELETE /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 05:39:09.584642 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-9dbf80af-e63d-4e95-a786-1c6fada28aaf tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:39:09.585363 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-9dbf80af-e63d-4e95-a786-1c6fada28aaf tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] [instance: 549e692f-7b6f-4ab0-987b-986a1934630e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:39:09.603128 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9dbf80af-e63d-4e95-a786-1c6fada28aaf tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:39:09.604967 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9dbf80af-e63d-4e95-a786-1c6fada28aaf tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:39:09.604967 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9dbf80af-e63d-4e95-a786-1c6fada28aaf tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:39:09.604967 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9dbf80af-e63d-4e95-a786-1c6fada28aaf tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:39:09.742345 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-9dbf80af-e63d-4e95-a786-1c6fada28aaf tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d859e797d874c948325f2ce0978edb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5989fabc615545eeb4ef987dea566175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:39:09.746172 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=95,nova_cell1:INSERT=3 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:09.750641 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-9dbf80af-e63d-4e95-a786-1c6fada28aaf tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] 10.222.0.33 "GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e" status: 200 len: 1555 microversion: 2.1 time: 0.171108 Jul 28 05:39:09.751240 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 701/925] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:39:09 2022] GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e => generated 1555 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:39:10.773066 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-3a6e7d4b-32af-459d-8cbe-bb00aea7c41e tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:39:10.773877 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-3a6e7d4b-32af-459d-8cbe-bb00aea7c41e tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] [instance: 549e692f-7b6f-4ab0-987b-986a1934630e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:39:10.781365 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3a6e7d4b-32af-459d-8cbe-bb00aea7c41e tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:39:10.781876 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3a6e7d4b-32af-459d-8cbe-bb00aea7c41e tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:39:10.782647 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3a6e7d4b-32af-459d-8cbe-bb00aea7c41e tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:39:10.783084 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3a6e7d4b-32af-459d-8cbe-bb00aea7c41e tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:39:10.923217 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-3a6e7d4b-32af-459d-8cbe-bb00aea7c41e tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d859e797d874c948325f2ce0978edb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5989fabc615545eeb4ef987dea566175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:39:10.931112 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-3a6e7d4b-32af-459d-8cbe-bb00aea7c41e tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] 10.222.0.33 "GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e" status: 200 len: 1555 microversion: 2.1 time: 0.162699 Jul 28 05:39:10.931777 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 702/926] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:39:10 2022] GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e => generated 1555 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:39:11.891203 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-1e8c7b4e-3221-40f5-b4ff-4ac6003c5f13 req-59e1a76d-e72c-4921-b401-dc489f9f8ce7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "549e692f-7b6f-4ab0-987b-986a1934630e", "name": "network-vif-deleted", "tag": "b49100c3-29f8-45db-910f-805da59e6250"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:39:11.902681 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-1e8c7b4e-3221-40f5-b4ff-4ac6003c5f13 req-59e1a76d-e72c-4921-b401-dc489f9f8ce7 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:39:11.903129 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-1e8c7b4e-3221-40f5-b4ff-4ac6003c5f13 req-59e1a76d-e72c-4921-b401-dc489f9f8ce7 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:39:11.915758 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-1e8c7b4e-3221-40f5-b4ff-4ac6003c5f13 req-59e1a76d-e72c-4921-b401-dc489f9f8ce7 service nova] Creating event network-vif-deleted:b49100c3-29f8-45db-910f-805da59e6250 for instance 549e692f-7b6f-4ab0-987b-986a1934630e on hv-cinder-79987 Jul 28 05:39:11.921288 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-1e8c7b4e-3221-40f5-b4ff-4ac6003c5f13 req-59e1a76d-e72c-4921-b401-dc489f9f8ce7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033637 Jul 28 05:39:11.922124 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 703/927] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:39:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 05:39:11.954114 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-e2818538-38d5-4bd3-8eff-c79f2dfd8bab tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:39:11.954838 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-e2818538-38d5-4bd3-8eff-c79f2dfd8bab tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] [instance: 549e692f-7b6f-4ab0-987b-986a1934630e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:39:11.961746 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e2818538-38d5-4bd3-8eff-c79f2dfd8bab tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:39:11.962314 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e2818538-38d5-4bd3-8eff-c79f2dfd8bab tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:39:11.963292 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e2818538-38d5-4bd3-8eff-c79f2dfd8bab tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:39:11.963722 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e2818538-38d5-4bd3-8eff-c79f2dfd8bab tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:39:12.037771 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-e2818538-38d5-4bd3-8eff-c79f2dfd8bab tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d859e797d874c948325f2ce0978edb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5989fabc615545eeb4ef987dea566175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:39:12.045388 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-e2818538-38d5-4bd3-8eff-c79f2dfd8bab tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] 10.222.0.33 "GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e" status: 200 len: 1513 microversion: 2.1 time: 0.095654 Jul 28 05:39:12.046015 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 704/928] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:39:11 2022] GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e => generated 1513 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:39:13.072814 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-459ea304-c48e-41ac-89f4-9de9507cd633 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:39:13.074132 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-459ea304-c48e-41ac-89f4-9de9507cd633 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] [instance: 549e692f-7b6f-4ab0-987b-986a1934630e] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:39:13.082867 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-459ea304-c48e-41ac-89f4-9de9507cd633 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:39:13.083311 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-459ea304-c48e-41ac-89f4-9de9507cd633 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:39:13.084133 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-459ea304-c48e-41ac-89f4-9de9507cd633 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:39:13.084579 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-459ea304-c48e-41ac-89f4-9de9507cd633 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:39:13.100123 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.wsgi [None req-459ea304-c48e-41ac-89f4-9de9507cd633 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] HTTP exception thrown: Instance 549e692f-7b6f-4ab0-987b-986a1934630e could not be found. Jul 28 05:39:13.101775 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-459ea304-c48e-41ac-89f4-9de9507cd633 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Request method failure captured: Jul 28 05:39:13.101775 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: request: GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e HTTP/1.1 Jul 28 05:39:13.101775 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept: application/json Jul 28 05:39:13.101775 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept-Encoding: identity Jul 28 05:39:13.101775 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Connection: close Jul 28 05:39:13.101775 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Length: 0 Jul 28 05:39:13.101775 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Type: application/json Jul 28 05:39:13.101775 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Host: 10.222.0.33 Jul 28 05:39:13.101775 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Openstack-System-Scope: None Jul 28 05:39:13.101775 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: User-Agent: python-urllib3/1.26.10 Jul 28 05:39:13.101775 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Auth-Token: gAAAAABi4iBY8mdy966V2dGqyfw-f7QDQ6gspKAM-ufUe8kNzCCBJ3C7E8-bdJqpCi7sOwxLWqMJQjpkDvcTYf5AsubGcgQRq-hwIz3qX1nX_xK2vwMfMvfbCZ5UUYVvkLxRjLFdDGqxl4A0RdXEJLIWYs5Bva_GsXuYNatLTBSrbHA_3vrAMek Jul 28 05:39:13.101775 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Id: None Jul 28 05:39:13.101775 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Name: None Jul 28 05:39:13.101775 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Identity-Status: Confirmed Jul 28 05:39:13.101775 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Is-Admin-Project: True Jul 28 05:39:13.101775 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Id: default Jul 28 05:39:13.101775 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Name: Default Jul 28 05:39:13.101775 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Id: 5989fabc615545eeb4ef987dea566175 Jul 28 05:39:13.101775 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Name: tempest-TestMinimumBasicScenario-838793625 Jul 28 05:39:13.101775 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Role: member,reader Jul 28 05:39:13.101775 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Roles: member,reader Jul 28 05:39:13.109767 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5989fabc615545eeb4ef987dea566175"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5989fabc615545eeb4ef987dea566175"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5989fabc615545eeb4ef987dea566175", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5989fabc615545eeb4ef987dea566175"}]}] Jul 28 05:39:13.109767 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant: tempest-TestMinimumBasicScenario-838793625 Jul 28 05:39:13.109767 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Id: 5989fabc615545eeb4ef987dea566175 Jul 28 05:39:13.109767 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Name: tempest-TestMinimumBasicScenario-838793625 Jul 28 05:39:13.109767 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User: tempest-TestMinimumBasicScenario-838793625-project Jul 28 05:39:13.109767 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Id: default Jul 28 05:39:13.109767 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Name: Default Jul 28 05:39:13.109767 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Id: 7d859e797d874c948325f2ce0978edb6 Jul 28 05:39:13.109767 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Name: tempest-TestMinimumBasicScenario-838793625-project Jul 28 05:39:13.109767 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: method: > Jul 28 05:39:13.109767 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: exception: Instance 549e692f-7b6f-4ab0-987b-986a1934630e could not be found. Jul 28 05:39:13.109767 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: action_args: {'id': '549e692f-7b6f-4ab0-987b-986a1934630e'} Jul 28 05:39:13.111048 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 05:39:13.111048 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:39:13.111048 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 05:39:13.111048 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 05:39:13.111048 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 05:39:13.111048 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 05:39:13.111048 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 05:39:13.111048 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 05:39:13.111048 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 05:39:13.111048 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 05:39:13.111048 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 549e692f-7b6f-4ab0-987b-986a1934630e could not be found. Jul 28 05:39:13.111048 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:39:13.111048 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:39:13.111048 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:39:13.111048 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:39:13.111048 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:39:13.111048 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:39:13.111048 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 05:39:13.111048 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 05:39:13.111048 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 05:39:13.112503 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:39:13.112503 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 05:39:13.112503 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 05:39:13.112503 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 05:39:13.112503 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 05:39:13.112503 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 05:39:13.112503 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 05:39:13.112503 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 549e692f-7b6f-4ab0-987b-986a1934630e could not be found. Jul 28 05:39:13.112503 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:39:13.112503 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:39:13.112503 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:39:13.112503 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:39:13.112503 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:39:13.112503 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:39:13.112503 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 05:39:13.112503 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 05:39:13.112503 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 549e692f-7b6f-4ab0-987b-986a1934630e could not be found. Jul 28 05:39:13.112503 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:39:13.113869 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-459ea304-c48e-41ac-89f4-9de9507cd633 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Returning 404 to user: Instance 549e692f-7b6f-4ab0-987b-986a1934630e could not be found. {{(pid=124482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 05:39:13.113869 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-459ea304-c48e-41ac-89f4-9de9507cd633 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] 10.222.0.33 "GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e" status: 404 len: 111 microversion: 2.1 time: 0.036883 Jul 28 05:39:13.113869 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 705/929] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:39:13 2022] GET /compute/v2.1/servers/549e692f-7b6f-4ab0-987b-986a1934630e => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 05:39:13.113869 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-13ca3259-08cf-4ba2-9a98-d084f6df96d0 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] Calling method '.version_select at 0x7f25e04fa8b0>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:39:13.205376 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-13ca3259-08cf-4ba2-9a98-d084f6df96d0 tempest-TestMinimumBasicScenario-838793625 tempest-TestMinimumBasicScenario-838793625-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-759463288" status: 202 len: 0 microversion: 2.1 time: 0.096902 Jul 28 05:39:13.206964 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 706/930] 10.222.0.33 () {58 vars in 1269 bytes} [Thu Jul 28 05:39:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-759463288 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 05:39:41.105490 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell1:SELECT=16 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:41.106455 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:41.327057 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-de6ac62e-0454-437e-9e4c-dbdc7c027c35 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Action: 'create', calling method: .version_select at 0x7f25e4bf1310>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-394088638", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFiV151cvnlMLxiWMWq7sz/rPOR4uFp+bQ16SRrgRh6gsThvpcMT8JJHUGiS1xFa+LUrehuYn+FVhxQEWieH+BCe8FchlqNPGHyILOmRyTAEAUBnsI/ZLmG4QykGIsBjZQ=="}} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:39:41.344391 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.quota [None req-de6ac62e-0454-437e-9e4c-dbdc7c027c35 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Getting quotas for project 049ba77de43b4702832529d687f5f7a3. Resources: {'key_pairs'} {{(pid=124482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 05:39:41.349972 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.quota [None req-de6ac62e-0454-437e-9e4c-dbdc7c027c35 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Getting quotas for user 09217832f8e74db38d990d25faee4305 and project 049ba77de43b4702832529d687f5f7a3. Resources: {'key_pairs'} {{(pid=124482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 05:39:41.457759 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-de6ac62e-0454-437e-9e4c-dbdc7c027c35 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.353659 Jul 28 05:39:41.458334 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 707/931] 10.222.0.33 () {60 vars in 1159 bytes} [Thu Jul 28 05:39:41 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 05:40:11.722543 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell0:SELECT=4 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:11.727819 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-581d08c2-4dc6-4a3f-9632-94b3334de410 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1859680452", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-394088638", "security_groups": [{"name": "tempest-secgroup-smoke-88218149"}], "block_device_mapping_v2": [{"uuid": "84818220-abd2-4100-99bd-e3f2d8a8ae3a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5edb77fb-18f0-41c1-85ec-83f10d2e2f1e"}]}} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:40:11.868648 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.network.neutron [None req-581d08c2-4dc6-4a3f-9632-94b3334de410 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] validate_networks() for [('5edb77fb-18f0-41c1-85ec-83f10d2e2f1e', None, None, None, None, None)] {{(pid=124482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 05:40:12.294861 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-581d08c2-4dc6-4a3f-9632-94b3334de410 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Flavor limits 0:0:0 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 05:40:12.295303 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-581d08c2-4dc6-4a3f-9632-94b3334de410 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Image limits 0:0:0 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 05:40:12.295762 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-581d08c2-4dc6-4a3f-9632-94b3334de410 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Flavor pref 0:0:0 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 05:40:12.296169 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-581d08c2-4dc6-4a3f-9632-94b3334de410 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Image pref 0:0:0 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 05:40:12.296634 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-581d08c2-4dc6-4a3f-9632-94b3334de410 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 05:40:12.306494 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-581d08c2-4dc6-4a3f-9632-94b3334de410 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:12.308198 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-581d08c2-4dc6-4a3f-9632-94b3334de410 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:12.308198 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-581d08c2-4dc6-4a3f-9632-94b3334de410 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:12.308198 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-581d08c2-4dc6-4a3f-9632-94b3334de410 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:12.325539 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.quota [None req-581d08c2-4dc6-4a3f-9632-94b3334de410 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Getting quotas for project 049ba77de43b4702832529d687f5f7a3. Resources: {'ram', 'instances', 'cores'} {{(pid=124482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 05:40:12.330381 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.quota [None req-581d08c2-4dc6-4a3f-9632-94b3334de410 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Getting quotas for user 09217832f8e74db38d990d25faee4305 and project 049ba77de43b4702832529d687f5f7a3. Resources: {'ram', 'instances', 'cores'} {{(pid=124482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 05:40:12.389756 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-581d08c2-4dc6-4a3f-9632-94b3334de410 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Going to run 1 instances... {{(pid=124482) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 05:40:12.392509 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-581d08c2-4dc6-4a3f-9632-94b3334de410 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: 72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='84818220-abd2-4100-99bd-e3f2d8a8ae3a',volume_size=None,volume_type=None)] {{(pid=124482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 05:40:12.788370 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-581d08c2-4dc6-4a3f-9632-94b3334de410 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.067076 Jul 28 05:40:12.794241 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 708/932] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Jul 28 05:40:11 2022] POST /compute/v2.1/servers => generated 404 bytes in 1069 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 05:40:12.805274 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-c7ed4a1d-693a-4291-92a6-ea8253c9ddb8 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:40:12.805928 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-c7ed4a1d-693a-4291-92a6-ea8253c9ddb8 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: 72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:40:12.879350 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-c7ed4a1d-693a-4291-92a6-ea8253c9ddb8 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09217832f8e74db38d990d25faee4305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049ba77de43b4702832529d687f5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:40:12.887949 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-c7ed4a1d-693a-4291-92a6-ea8253c9ddb8 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "GET /compute/v2.1/servers/72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18" status: 200 len: 1094 microversion: 2.1 time: 0.086711 Jul 28 05:40:12.888713 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 709/933] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:40:12 2022] GET /compute/v2.1/servers/72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18 => generated 1094 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:40:13.909590 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-255723a9-6d88-4133-9fd5-f5567ccc8c74 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:40:13.910207 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-255723a9-6d88-4133-9fd5-f5567ccc8c74 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: 72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:40:13.965304 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-255723a9-6d88-4133-9fd5-f5567ccc8c74 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09217832f8e74db38d990d25faee4305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049ba77de43b4702832529d687f5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:40:13.972402 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-255723a9-6d88-4133-9fd5-f5567ccc8c74 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "GET /compute/v2.1/servers/72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18" status: 200 len: 1094 microversion: 2.1 time: 0.066665 Jul 28 05:40:13.977620 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 710/934] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:40:13 2022] GET /compute/v2.1/servers/72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18 => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:40:14.993593 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-8a499151-fe82-47b0-8abe-92ea7c43de4c tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:40:14.994247 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-8a499151-fe82-47b0-8abe-92ea7c43de4c tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: 72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:40:15.001105 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8a499151-fe82-47b0-8abe-92ea7c43de4c tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:15.001569 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8a499151-fe82-47b0-8abe-92ea7c43de4c tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:15.003136 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8a499151-fe82-47b0-8abe-92ea7c43de4c tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:15.003437 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8a499151-fe82-47b0-8abe-92ea7c43de4c tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:15.077698 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-8a499151-fe82-47b0-8abe-92ea7c43de4c tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09217832f8e74db38d990d25faee4305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049ba77de43b4702832529d687f5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:40:15.086510 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-8a499151-fe82-47b0-8abe-92ea7c43de4c tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "GET /compute/v2.1/servers/72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18" status: 200 len: 1192 microversion: 2.1 time: 0.096967 Jul 28 05:40:15.087098 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 711/935] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:40:14 2022] GET /compute/v2.1/servers/72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18 => generated 1192 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:40:16.109432 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-21512ef4-1c73-4fca-b620-1f7e6ddc917a tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:40:16.110206 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-21512ef4-1c73-4fca-b620-1f7e6ddc917a tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: 72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:40:16.117790 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-21512ef4-1c73-4fca-b620-1f7e6ddc917a tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:16.118314 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-21512ef4-1c73-4fca-b620-1f7e6ddc917a tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:16.119178 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-21512ef4-1c73-4fca-b620-1f7e6ddc917a tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:16.119687 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-21512ef4-1c73-4fca-b620-1f7e6ddc917a tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:16.182399 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-21512ef4-1c73-4fca-b620-1f7e6ddc917a tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09217832f8e74db38d990d25faee4305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049ba77de43b4702832529d687f5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:40:16.190025 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-21512ef4-1c73-4fca-b620-1f7e6ddc917a tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "GET /compute/v2.1/servers/72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18" status: 200 len: 1210 microversion: 2.1 time: 0.084476 Jul 28 05:40:16.190698 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 712/936] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:40:16 2022] GET /compute/v2.1/servers/72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18 => generated 1210 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:40:17.213766 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-0d6c7555-f1ce-46d6-8fa4-e5da1221cb92 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:40:17.215123 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-0d6c7555-f1ce-46d6-8fa4-e5da1221cb92 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: 72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:40:17.222059 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-0d6c7555-f1ce-46d6-8fa4-e5da1221cb92 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:17.222811 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-0d6c7555-f1ce-46d6-8fa4-e5da1221cb92 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:17.223787 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-0d6c7555-f1ce-46d6-8fa4-e5da1221cb92 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:17.224401 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-0d6c7555-f1ce-46d6-8fa4-e5da1221cb92 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:17.396852 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-0d6c7555-f1ce-46d6-8fa4-e5da1221cb92 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09217832f8e74db38d990d25faee4305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049ba77de43b4702832529d687f5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:40:17.409963 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-0d6c7555-f1ce-46d6-8fa4-e5da1221cb92 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "GET /compute/v2.1/servers/72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18" status: 200 len: 1276 microversion: 2.1 time: 0.200014 Jul 28 05:40:17.410584 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 713/937] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:40:17 2022] GET /compute/v2.1/servers/72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18 => generated 1276 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:40:17.451057 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-45daa609-e68a-4c40-b2e7-71a6abffa012 req-f05bbadc-a421-4ae9-8b89-7c2b7ed1952e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18", "tag": "85e26040-6cb9-426b-976c-2e7e7a1a5ca5"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:40:17.459078 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-45daa609-e68a-4c40-b2e7-71a6abffa012 req-f05bbadc-a421-4ae9-8b89-7c2b7ed1952e service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:17.460503 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-45daa609-e68a-4c40-b2e7-71a6abffa012 req-f05bbadc-a421-4ae9-8b89-7c2b7ed1952e service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:17.472468 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-45daa609-e68a-4c40-b2e7-71a6abffa012 req-f05bbadc-a421-4ae9-8b89-7c2b7ed1952e service nova] Creating event network-changed:85e26040-6cb9-426b-976c-2e7e7a1a5ca5 for instance 72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18 on hv-cinder-79987 Jul 28 05:40:17.478469 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-45daa609-e68a-4c40-b2e7-71a6abffa012 req-f05bbadc-a421-4ae9-8b89-7c2b7ed1952e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035009 Jul 28 05:40:17.482965 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 714/938] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 05:40:18.432932 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-ec2c21ed-f921-4fd4-ae31-2c7354b43471 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:40:18.433654 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-ec2c21ed-f921-4fd4-ae31-2c7354b43471 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: 72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:40:18.439893 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ec2c21ed-f921-4fd4-ae31-2c7354b43471 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:18.440340 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ec2c21ed-f921-4fd4-ae31-2c7354b43471 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:18.441132 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ec2c21ed-f921-4fd4-ae31-2c7354b43471 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:18.442420 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ec2c21ed-f921-4fd4-ae31-2c7354b43471 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:18.577723 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-ec2c21ed-f921-4fd4-ae31-2c7354b43471 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09217832f8e74db38d990d25faee4305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049ba77de43b4702832529d687f5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:40:18.585346 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-ec2c21ed-f921-4fd4-ae31-2c7354b43471 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "GET /compute/v2.1/servers/72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18" status: 200 len: 1264 microversion: 2.1 time: 0.157314 Jul 28 05:40:18.585943 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 715/939] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:40:18 2022] GET /compute/v2.1/servers/72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:40:19.606462 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-c289128f-912f-4957-91d2-4e435eebefa4 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:40:19.607128 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-c289128f-912f-4957-91d2-4e435eebefa4 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: 72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:40:19.613485 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c289128f-912f-4957-91d2-4e435eebefa4 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:19.613995 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c289128f-912f-4957-91d2-4e435eebefa4 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:19.614762 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c289128f-912f-4957-91d2-4e435eebefa4 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:19.615205 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c289128f-912f-4957-91d2-4e435eebefa4 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:19.743401 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-c289128f-912f-4957-91d2-4e435eebefa4 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09217832f8e74db38d990d25faee4305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049ba77de43b4702832529d687f5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:40:19.750740 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-c289128f-912f-4957-91d2-4e435eebefa4 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "GET /compute/v2.1/servers/72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18" status: 200 len: 1264 microversion: 2.1 time: 0.148150 Jul 28 05:40:19.751296 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 716/940] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:40:19 2022] GET /compute/v2.1/servers/72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18 => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:40:20.771940 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-b0088fea-5db1-4a3a-8e61-75e6e49b06da tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:40:20.772624 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-b0088fea-5db1-4a3a-8e61-75e6e49b06da tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: 72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:40:20.779148 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b0088fea-5db1-4a3a-8e61-75e6e49b06da tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:20.779589 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b0088fea-5db1-4a3a-8e61-75e6e49b06da tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:20.780432 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b0088fea-5db1-4a3a-8e61-75e6e49b06da tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:20.780863 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b0088fea-5db1-4a3a-8e61-75e6e49b06da tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:20.910612 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-b0088fea-5db1-4a3a-8e61-75e6e49b06da tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09217832f8e74db38d990d25faee4305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049ba77de43b4702832529d687f5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:40:20.917965 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-b0088fea-5db1-4a3a-8e61-75e6e49b06da tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "GET /compute/v2.1/servers/72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18" status: 200 len: 1264 microversion: 2.1 time: 0.150677 Jul 28 05:40:20.918534 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 717/941] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:40:20 2022] GET /compute/v2.1/servers/72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:40:21.938628 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-6849dbda-a8a0-4064-8d6c-b2b3e803072a tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:40:21.939252 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-6849dbda-a8a0-4064-8d6c-b2b3e803072a tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: 72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:40:21.945686 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-6849dbda-a8a0-4064-8d6c-b2b3e803072a tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:21.946132 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-6849dbda-a8a0-4064-8d6c-b2b3e803072a tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:21.946884 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-6849dbda-a8a0-4064-8d6c-b2b3e803072a tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:21.947314 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-6849dbda-a8a0-4064-8d6c-b2b3e803072a tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:22.080556 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-6849dbda-a8a0-4064-8d6c-b2b3e803072a tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09217832f8e74db38d990d25faee4305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049ba77de43b4702832529d687f5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:40:22.088531 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-6849dbda-a8a0-4064-8d6c-b2b3e803072a tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "GET /compute/v2.1/servers/72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18" status: 200 len: 1264 microversion: 2.1 time: 0.153679 Jul 28 05:40:22.089039 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 718/942] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:40:21 2022] GET /compute/v2.1/servers/72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:40:23.109912 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-9248b541-100e-49fe-88d3-7440c0d92fd8 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:40:23.110550 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-9248b541-100e-49fe-88d3-7440c0d92fd8 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: 72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:40:23.114326 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell0:SELECT=2 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:23.118286 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9248b541-100e-49fe-88d3-7440c0d92fd8 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:23.118729 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9248b541-100e-49fe-88d3-7440c0d92fd8 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:23.119476 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9248b541-100e-49fe-88d3-7440c0d92fd8 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:23.119901 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9248b541-100e-49fe-88d3-7440c0d92fd8 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:23.250845 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-9248b541-100e-49fe-88d3-7440c0d92fd8 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09217832f8e74db38d990d25faee4305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049ba77de43b4702832529d687f5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:40:23.258212 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-9248b541-100e-49fe-88d3-7440c0d92fd8 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "GET /compute/v2.1/servers/72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18" status: 200 len: 1264 microversion: 2.1 time: 0.152058 Jul 28 05:40:23.258851 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 719/943] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:40:23 2022] GET /compute/v2.1/servers/72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:40:24.279272 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-c9474a0c-e8cf-4ac9-96be-cd50a432e88c tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:40:24.279883 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-c9474a0c-e8cf-4ac9-96be-cd50a432e88c tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: 72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:40:24.281789 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell0:SELECT=10 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:24.287214 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c9474a0c-e8cf-4ac9-96be-cd50a432e88c tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:24.287664 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c9474a0c-e8cf-4ac9-96be-cd50a432e88c tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:24.288425 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c9474a0c-e8cf-4ac9-96be-cd50a432e88c tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:24.288860 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c9474a0c-e8cf-4ac9-96be-cd50a432e88c tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:24.423556 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-c9474a0c-e8cf-4ac9-96be-cd50a432e88c tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09217832f8e74db38d990d25faee4305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049ba77de43b4702832529d687f5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:40:24.432072 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-c9474a0c-e8cf-4ac9-96be-cd50a432e88c tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "GET /compute/v2.1/servers/72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18" status: 200 len: 1264 microversion: 2.1 time: 0.156581 Jul 28 05:40:24.432721 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 720/944] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:40:24 2022] GET /compute/v2.1/servers/72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:40:25.453908 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-d668c4e3-cb00-4eb2-b060-8e4f80c26adb tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:40:25.454561 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-d668c4e3-cb00-4eb2-b060-8e4f80c26adb tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: 72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:40:25.461761 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d668c4e3-cb00-4eb2-b060-8e4f80c26adb tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:25.462251 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d668c4e3-cb00-4eb2-b060-8e4f80c26adb tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:25.462999 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d668c4e3-cb00-4eb2-b060-8e4f80c26adb tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:25.463428 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d668c4e3-cb00-4eb2-b060-8e4f80c26adb tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:25.599270 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-d668c4e3-cb00-4eb2-b060-8e4f80c26adb tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09217832f8e74db38d990d25faee4305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049ba77de43b4702832529d687f5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:40:25.606577 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-d668c4e3-cb00-4eb2-b060-8e4f80c26adb tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "GET /compute/v2.1/servers/72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18" status: 200 len: 1264 microversion: 2.1 time: 0.156476 Jul 28 05:40:25.607118 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 721/945] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:40:25 2022] GET /compute/v2.1/servers/72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:40:26.629337 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-9e3623e6-5b96-4546-9ca2-aa05b3e02a00 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:40:26.630063 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-9e3623e6-5b96-4546-9ca2-aa05b3e02a00 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: 72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:40:26.637155 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9e3623e6-5b96-4546-9ca2-aa05b3e02a00 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:26.637738 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9e3623e6-5b96-4546-9ca2-aa05b3e02a00 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:26.638571 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9e3623e6-5b96-4546-9ca2-aa05b3e02a00 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:26.639157 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9e3623e6-5b96-4546-9ca2-aa05b3e02a00 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:27.045441 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-9e3623e6-5b96-4546-9ca2-aa05b3e02a00 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09217832f8e74db38d990d25faee4305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049ba77de43b4702832529d687f5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:40:27.053713 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-9e3623e6-5b96-4546-9ca2-aa05b3e02a00 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "GET /compute/v2.1/servers/72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18" status: 200 len: 1264 microversion: 2.1 time: 0.429313 Jul 28 05:40:27.054294 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 722/946] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:40:26 2022] GET /compute/v2.1/servers/72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18 => generated 1264 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:40:28.074090 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-81182f74-4e55-4986-bd4e-87cbf5692311 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:40:28.074736 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-81182f74-4e55-4986-bd4e-87cbf5692311 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: 72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:40:28.081438 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-81182f74-4e55-4986-bd4e-87cbf5692311 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:28.081607 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-81182f74-4e55-4986-bd4e-87cbf5692311 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:28.082298 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-81182f74-4e55-4986-bd4e-87cbf5692311 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:28.088972 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-81182f74-4e55-4986-bd4e-87cbf5692311 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:28.243671 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-81182f74-4e55-4986-bd4e-87cbf5692311 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09217832f8e74db38d990d25faee4305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049ba77de43b4702832529d687f5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:40:28.251443 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-81182f74-4e55-4986-bd4e-87cbf5692311 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "GET /compute/v2.1/servers/72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18" status: 200 len: 1264 microversion: 2.1 time: 0.181379 Jul 28 05:40:28.252574 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 723/947] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:40:28 2022] GET /compute/v2.1/servers/72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18 => generated 1264 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:40:28.391943 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-d6aa01ac-b465-45f3-a185-13af8056f8a0 req-2ed0b840-4840-449d-996d-84c4b7d09bdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18", "name": "network-vif-plugged", "status": "completed", "tag": "85e26040-6cb9-426b-976c-2e7e7a1a5ca5"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:40:28.403718 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-d6aa01ac-b465-45f3-a185-13af8056f8a0 req-2ed0b840-4840-449d-996d-84c4b7d09bdb service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:28.404802 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-d6aa01ac-b465-45f3-a185-13af8056f8a0 req-2ed0b840-4840-449d-996d-84c4b7d09bdb service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:28.420166 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-d6aa01ac-b465-45f3-a185-13af8056f8a0 req-2ed0b840-4840-449d-996d-84c4b7d09bdb service nova] Creating event network-vif-plugged:85e26040-6cb9-426b-976c-2e7e7a1a5ca5 for instance 72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18 on hv-cinder-79987 Jul 28 05:40:28.423308 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-d6aa01ac-b465-45f3-a185-13af8056f8a0 req-2ed0b840-4840-449d-996d-84c4b7d09bdb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043060 Jul 28 05:40:28.423925 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 724/948] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:40:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 05:40:29.276296 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-3a172b86-8803-460a-ad46-bb3aef1740cb tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:40:29.276984 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-3a172b86-8803-460a-ad46-bb3aef1740cb tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: 72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:40:29.284173 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3a172b86-8803-460a-ad46-bb3aef1740cb tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:29.284619 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3a172b86-8803-460a-ad46-bb3aef1740cb tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:29.290877 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3a172b86-8803-460a-ad46-bb3aef1740cb tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:29.290877 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3a172b86-8803-460a-ad46-bb3aef1740cb tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:29.421889 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-3a172b86-8803-460a-ad46-bb3aef1740cb tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09217832f8e74db38d990d25faee4305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049ba77de43b4702832529d687f5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:40:29.429758 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-3a172b86-8803-460a-ad46-bb3aef1740cb tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "GET /compute/v2.1/servers/72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18" status: 200 len: 1264 microversion: 2.1 time: 0.157535 Jul 28 05:40:29.430342 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 725/949] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:40:29 2022] GET /compute/v2.1/servers/72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:40:30.451753 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-3e30eb1b-3cce-431c-8b41-592a3e5e580d tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:40:30.452351 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-3e30eb1b-3cce-431c-8b41-592a3e5e580d tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: 72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:40:30.459448 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3e30eb1b-3cce-431c-8b41-592a3e5e580d tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:30.459894 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3e30eb1b-3cce-431c-8b41-592a3e5e580d tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:30.460654 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3e30eb1b-3cce-431c-8b41-592a3e5e580d tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:30.461089 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3e30eb1b-3cce-431c-8b41-592a3e5e580d tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:30.597273 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-3e30eb1b-3cce-431c-8b41-592a3e5e580d tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09217832f8e74db38d990d25faee4305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049ba77de43b4702832529d687f5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:40:30.605325 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-3e30eb1b-3cce-431c-8b41-592a3e5e580d tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "GET /compute/v2.1/servers/72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18" status: 200 len: 1264 microversion: 2.1 time: 0.157322 Jul 28 05:40:30.605932 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 726/950] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:40:30 2022] GET /compute/v2.1/servers/72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:40:31.626521 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-32f6b9b0-33c2-4e49-87b8-d49b2f17eee9 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:40:31.627161 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-32f6b9b0-33c2-4e49-87b8-d49b2f17eee9 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: 72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:40:31.634480 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-32f6b9b0-33c2-4e49-87b8-d49b2f17eee9 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:31.634940 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-32f6b9b0-33c2-4e49-87b8-d49b2f17eee9 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:31.635805 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-32f6b9b0-33c2-4e49-87b8-d49b2f17eee9 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:31.636239 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-32f6b9b0-33c2-4e49-87b8-d49b2f17eee9 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:31.772105 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-32f6b9b0-33c2-4e49-87b8-d49b2f17eee9 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09217832f8e74db38d990d25faee4305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049ba77de43b4702832529d687f5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:40:31.779784 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-32f6b9b0-33c2-4e49-87b8-d49b2f17eee9 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "GET /compute/v2.1/servers/72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18" status: 200 len: 1264 microversion: 2.1 time: 0.157183 Jul 28 05:40:31.780439 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 727/951] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:40:31 2022] GET /compute/v2.1/servers/72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:40:32.381497 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-240f3b7e-c9fb-436b-b1c4-a465162d9097 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1448428099", "imageRef": "4f0ce061-6677-4c2a-9ee1-54a100f21462", "flavorRef": "452"}} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:40:32.438498 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.network.neutron [None req-240f3b7e-c9fb-436b-b1c4-a465162d9097 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] validate_networks() for None {{(pid=124482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 05:40:32.781919 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-240f3b7e-c9fb-436b-b1c4-a465162d9097 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Flavor limits 0:0:0 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 05:40:32.782529 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-240f3b7e-c9fb-436b-b1c4-a465162d9097 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Image limits 0:0:0 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 05:40:32.782795 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-240f3b7e-c9fb-436b-b1c4-a465162d9097 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Flavor pref 0:0:0 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 05:40:32.783230 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-240f3b7e-c9fb-436b-b1c4-a465162d9097 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Image pref 0:0:0 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 05:40:32.783682 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-240f3b7e-c9fb-436b-b1c4-a465162d9097 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 05:40:32.793155 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-240f3b7e-c9fb-436b-b1c4-a465162d9097 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:32.793643 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-240f3b7e-c9fb-436b-b1c4-a465162d9097 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:32.794445 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-240f3b7e-c9fb-436b-b1c4-a465162d9097 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:32.794885 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-240f3b7e-c9fb-436b-b1c4-a465162d9097 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:32.812569 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.quota [None req-240f3b7e-c9fb-436b-b1c4-a465162d9097 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Getting quotas for project 2a92cc42de224a0290e6328adb1e1924. Resources: {'ram', 'instances', 'cores'} {{(pid=124482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 05:40:32.817322 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.quota [None req-240f3b7e-c9fb-436b-b1c4-a465162d9097 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Getting quotas for user 48fbe830d1e74e49a869802f8094be90 and project 2a92cc42de224a0290e6328adb1e1924. Resources: {'ram', 'instances', 'cores'} {{(pid=124482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 05:40:32.828790 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-240f3b7e-c9fb-436b-b1c4-a465162d9097 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Going to run 1 instances... {{(pid=124482) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 05:40:32.831139 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-240f3b7e-c9fb-436b-b1c4-a465162d9097 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] [instance: 005f817e-3e43-49df-bc90-dc094b66fed8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f0ce061-6677-4c2a-9ee1-54a100f21462',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 05:40:32.989128 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-240f3b7e-c9fb-436b-b1c4-a465162d9097 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.612688 Jul 28 05:40:32.989729 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 728/952] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Jul 28 05:40:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 05:40:32.994248 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-4937b889-f004-4901-a2c8-c3a411ead5cc tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:40:32.994861 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-4937b889-f004-4901-a2c8-c3a411ead5cc tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: 72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:40:33.001290 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4937b889-f004-4901-a2c8-c3a411ead5cc tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:33.001772 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4937b889-f004-4901-a2c8-c3a411ead5cc tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:33.002538 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4937b889-f004-4901-a2c8-c3a411ead5cc tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:33.002975 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4937b889-f004-4901-a2c8-c3a411ead5cc tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:33.007102 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell1:SELECT=100 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:33.164756 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-4937b889-f004-4901-a2c8-c3a411ead5cc tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09217832f8e74db38d990d25faee4305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049ba77de43b4702832529d687f5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:40:33.173213 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-4937b889-f004-4901-a2c8-c3a411ead5cc tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "GET /compute/v2.1/servers/72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18" status: 200 len: 1452 microversion: 2.1 time: 0.182217 Jul 28 05:40:33.173598 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 729/953] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:40:32 2022] GET /compute/v2.1/servers/72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18 => generated 1452 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:40:33.178756 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-c3eb5404-ab1e-422a-a9fe-332ced593af8 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:40:33.179357 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-c3eb5404-ab1e-422a-a9fe-332ced593af8 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] [instance: 005f817e-3e43-49df-bc90-dc094b66fed8] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:40:33.242643 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-c3eb5404-ab1e-422a-a9fe-332ced593af8 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fbe830d1e74e49a869802f8094be90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a92cc42de224a0290e6328adb1e1924', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:40:33.249598 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-c3eb5404-ab1e-422a-a9fe-332ced593af8 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] 10.222.0.33 "GET /compute/v2.1/servers/005f817e-3e43-49df-bc90-dc094b66fed8" status: 200 len: 1215 microversion: 2.1 time: 0.074998 Jul 28 05:40:33.250237 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 730/954] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:40:33 2022] GET /compute/v2.1/servers/005f817e-3e43-49df-bc90-dc094b66fed8 => generated 1215 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:40:33.255210 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-0b4fba30-435f-4005-af10-bc7b130b57ca tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:40:33.255845 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-0b4fba30-435f-4005-af10-bc7b130b57ca tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: 72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:40:33.261698 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-0b4fba30-435f-4005-af10-bc7b130b57ca tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:33.262654 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-0b4fba30-435f-4005-af10-bc7b130b57ca tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:33.262985 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-0b4fba30-435f-4005-af10-bc7b130b57ca tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:33.263728 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-0b4fba30-435f-4005-af10-bc7b130b57ca tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:33.406756 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-0b4fba30-435f-4005-af10-bc7b130b57ca tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09217832f8e74db38d990d25faee4305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049ba77de43b4702832529d687f5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:40:33.415461 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-0b4fba30-435f-4005-af10-bc7b130b57ca tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "GET /compute/v2.1/servers/72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18" status: 200 len: 1452 microversion: 2.1 time: 0.164148 Jul 28 05:40:33.416308 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 731/955] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:40:33 2022] GET /compute/v2.1/servers/72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18 => generated 1452 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:40:34.272231 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-d6444a08-bbab-455b-9fd0-efb921a42e56 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:40:34.273108 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-d6444a08-bbab-455b-9fd0-efb921a42e56 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] [instance: 005f817e-3e43-49df-bc90-dc094b66fed8] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:40:34.279340 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d6444a08-bbab-455b-9fd0-efb921a42e56 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:34.279789 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d6444a08-bbab-455b-9fd0-efb921a42e56 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:34.280732 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d6444a08-bbab-455b-9fd0-efb921a42e56 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:34.281191 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d6444a08-bbab-455b-9fd0-efb921a42e56 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:34.350487 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-d6444a08-bbab-455b-9fd0-efb921a42e56 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fbe830d1e74e49a869802f8094be90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a92cc42de224a0290e6328adb1e1924', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:40:34.358233 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-d6444a08-bbab-455b-9fd0-efb921a42e56 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] 10.222.0.33 "GET /compute/v2.1/servers/005f817e-3e43-49df-bc90-dc094b66fed8" status: 200 len: 1219 microversion: 2.1 time: 0.091168 Jul 28 05:40:34.362477 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 732/956] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:40:34 2022] GET /compute/v2.1/servers/005f817e-3e43-49df-bc90-dc094b66fed8 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:40:35.380075 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-45cc368e-8e1d-4d9c-b562-093dbbac4e55 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:40:35.380724 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-45cc368e-8e1d-4d9c-b562-093dbbac4e55 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] [instance: 005f817e-3e43-49df-bc90-dc094b66fed8] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:40:35.384369 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:35.388475 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-45cc368e-8e1d-4d9c-b562-093dbbac4e55 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:35.388919 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-45cc368e-8e1d-4d9c-b562-093dbbac4e55 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:35.389701 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-45cc368e-8e1d-4d9c-b562-093dbbac4e55 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:35.390308 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-45cc368e-8e1d-4d9c-b562-093dbbac4e55 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:35.468499 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-45cc368e-8e1d-4d9c-b562-093dbbac4e55 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fbe830d1e74e49a869802f8094be90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a92cc42de224a0290e6328adb1e1924', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:40:35.480120 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-45cc368e-8e1d-4d9c-b562-093dbbac4e55 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] 10.222.0.33 "GET /compute/v2.1/servers/005f817e-3e43-49df-bc90-dc094b66fed8" status: 200 len: 1275 microversion: 2.1 time: 0.102027 Jul 28 05:40:35.480120 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 733/957] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:40:35 2022] GET /compute/v2.1/servers/005f817e-3e43-49df-bc90-dc094b66fed8 => generated 1275 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:40:35.779970 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-4ba6aef1-2efd-48bc-87d7-7a389f270865 req-6d53af91-bc57-45f3-bd3f-748bf99839cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18", "tag": "85e26040-6cb9-426b-976c-2e7e7a1a5ca5"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:40:35.790470 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-4ba6aef1-2efd-48bc-87d7-7a389f270865 req-6d53af91-bc57-45f3-bd3f-748bf99839cb service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:35.791002 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-4ba6aef1-2efd-48bc-87d7-7a389f270865 req-6d53af91-bc57-45f3-bd3f-748bf99839cb service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:35.802015 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-4ba6aef1-2efd-48bc-87d7-7a389f270865 req-6d53af91-bc57-45f3-bd3f-748bf99839cb service nova] Creating event network-changed:85e26040-6cb9-426b-976c-2e7e7a1a5ca5 for instance 72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18 on hv-cinder-79987 Jul 28 05:40:35.806956 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-4ba6aef1-2efd-48bc-87d7-7a389f270865 req-6d53af91-bc57-45f3-bd3f-748bf99839cb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031217 Jul 28 05:40:35.807720 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 734/958] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:40:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 05:40:36.501095 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-22f8d3da-2621-402a-89ab-4c091185d4a7 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:40:36.501818 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-22f8d3da-2621-402a-89ab-4c091185d4a7 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] [instance: 005f817e-3e43-49df-bc90-dc094b66fed8] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:40:36.518193 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-22f8d3da-2621-402a-89ab-4c091185d4a7 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:36.518193 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-22f8d3da-2621-402a-89ab-4c091185d4a7 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:36.518193 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-22f8d3da-2621-402a-89ab-4c091185d4a7 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:36.518193 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-22f8d3da-2621-402a-89ab-4c091185d4a7 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:36.610062 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-22f8d3da-2621-402a-89ab-4c091185d4a7 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fbe830d1e74e49a869802f8094be90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a92cc42de224a0290e6328adb1e1924', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:40:36.624018 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-22f8d3da-2621-402a-89ab-4c091185d4a7 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] 10.222.0.33 "GET /compute/v2.1/servers/005f817e-3e43-49df-bc90-dc094b66fed8" status: 200 len: 1273 microversion: 2.1 time: 0.128197 Jul 28 05:40:36.627622 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 735/959] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:40:36 2022] GET /compute/v2.1/servers/005f817e-3e43-49df-bc90-dc094b66fed8 => generated 1273 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:40:37.652446 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-68b53e28-e7c8-49e2-a330-ef0419ff9570 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:40:37.653050 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-68b53e28-e7c8-49e2-a330-ef0419ff9570 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] [instance: 005f817e-3e43-49df-bc90-dc094b66fed8] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:40:37.660508 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-68b53e28-e7c8-49e2-a330-ef0419ff9570 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:37.661116 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-68b53e28-e7c8-49e2-a330-ef0419ff9570 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:37.662086 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-68b53e28-e7c8-49e2-a330-ef0419ff9570 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:37.663295 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-68b53e28-e7c8-49e2-a330-ef0419ff9570 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:37.811198 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-68b53e28-e7c8-49e2-a330-ef0419ff9570 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fbe830d1e74e49a869802f8094be90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a92cc42de224a0290e6328adb1e1924', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:40:37.819649 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-68b53e28-e7c8-49e2-a330-ef0419ff9570 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] 10.222.0.33 "GET /compute/v2.1/servers/005f817e-3e43-49df-bc90-dc094b66fed8" status: 200 len: 1315 microversion: 2.1 time: 0.171051 Jul 28 05:40:37.820353 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 736/960] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:40:37 2022] GET /compute/v2.1/servers/005f817e-3e43-49df-bc90-dc094b66fed8 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:40:38.083154 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-19cd3967-38b1-4ad8-b314-d42f49a6d1ca req-f37b2d15-f3cd-44bb-90e5-adfa529de7e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "005f817e-3e43-49df-bc90-dc094b66fed8", "tag": "f719e24b-5b29-4a25-ad02-ca88e9278f7c"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:40:38.098142 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-19cd3967-38b1-4ad8-b314-d42f49a6d1ca req-f37b2d15-f3cd-44bb-90e5-adfa529de7e0 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:38.103112 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-19cd3967-38b1-4ad8-b314-d42f49a6d1ca req-f37b2d15-f3cd-44bb-90e5-adfa529de7e0 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:38.111790 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-19cd3967-38b1-4ad8-b314-d42f49a6d1ca req-f37b2d15-f3cd-44bb-90e5-adfa529de7e0 service nova] Creating event network-changed:f719e24b-5b29-4a25-ad02-ca88e9278f7c for instance 005f817e-3e43-49df-bc90-dc094b66fed8 on hv-cinder-79987 Jul 28 05:40:38.118294 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-19cd3967-38b1-4ad8-b314-d42f49a6d1ca req-f37b2d15-f3cd-44bb-90e5-adfa529de7e0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039017 Jul 28 05:40:38.118992 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 737/961] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:40:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:40:38.841291 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-dd81c721-7c08-45c9-b83f-9dc43a040849 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:40:38.842034 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-dd81c721-7c08-45c9-b83f-9dc43a040849 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] [instance: 005f817e-3e43-49df-bc90-dc094b66fed8] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:40:38.849290 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-dd81c721-7c08-45c9-b83f-9dc43a040849 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:38.850301 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-dd81c721-7c08-45c9-b83f-9dc43a040849 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:38.850621 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-dd81c721-7c08-45c9-b83f-9dc43a040849 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:38.851062 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-dd81c721-7c08-45c9-b83f-9dc43a040849 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:38.985696 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-dd81c721-7c08-45c9-b83f-9dc43a040849 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fbe830d1e74e49a869802f8094be90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a92cc42de224a0290e6328adb1e1924', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:40:38.993705 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-dd81c721-7c08-45c9-b83f-9dc43a040849 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] 10.222.0.33 "GET /compute/v2.1/servers/005f817e-3e43-49df-bc90-dc094b66fed8" status: 200 len: 1315 microversion: 2.1 time: 0.156521 Jul 28 05:40:38.994287 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 738/962] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:40:38 2022] GET /compute/v2.1/servers/005f817e-3e43-49df-bc90-dc094b66fed8 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:40:40.015013 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-fd19cdc7-1efb-4ab1-bf1a-b51a9bd972f2 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:40:40.015620 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-fd19cdc7-1efb-4ab1-bf1a-b51a9bd972f2 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] [instance: 005f817e-3e43-49df-bc90-dc094b66fed8] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:40:40.023886 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-fd19cdc7-1efb-4ab1-bf1a-b51a9bd972f2 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:40.024342 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-fd19cdc7-1efb-4ab1-bf1a-b51a9bd972f2 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:40.025345 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-fd19cdc7-1efb-4ab1-bf1a-b51a9bd972f2 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:40.025561 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-fd19cdc7-1efb-4ab1-bf1a-b51a9bd972f2 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:40.179306 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-fd19cdc7-1efb-4ab1-bf1a-b51a9bd972f2 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fbe830d1e74e49a869802f8094be90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a92cc42de224a0290e6328adb1e1924', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:40:40.186719 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-fd19cdc7-1efb-4ab1-bf1a-b51a9bd972f2 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] 10.222.0.33 "GET /compute/v2.1/servers/005f817e-3e43-49df-bc90-dc094b66fed8" status: 200 len: 1315 microversion: 2.1 time: 0.176110 Jul 28 05:40:40.187387 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 739/963] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:40:40 2022] GET /compute/v2.1/servers/005f817e-3e43-49df-bc90-dc094b66fed8 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:40:41.207955 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-84db8d07-2dc8-4ed6-99a4-e168229d841e tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:40:41.208670 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-84db8d07-2dc8-4ed6-99a4-e168229d841e tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] [instance: 005f817e-3e43-49df-bc90-dc094b66fed8] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:40:41.215305 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-84db8d07-2dc8-4ed6-99a4-e168229d841e tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:41.215749 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-84db8d07-2dc8-4ed6-99a4-e168229d841e tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:41.216503 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-84db8d07-2dc8-4ed6-99a4-e168229d841e tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:41.217019 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-84db8d07-2dc8-4ed6-99a4-e168229d841e tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:41.484098 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-84db8d07-2dc8-4ed6-99a4-e168229d841e tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fbe830d1e74e49a869802f8094be90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a92cc42de224a0290e6328adb1e1924', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:40:41.492824 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-84db8d07-2dc8-4ed6-99a4-e168229d841e tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] 10.222.0.33 "GET /compute/v2.1/servers/005f817e-3e43-49df-bc90-dc094b66fed8" status: 200 len: 1315 microversion: 2.1 time: 0.288862 Jul 28 05:40:41.493547 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 740/964] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:40:41 2022] GET /compute/v2.1/servers/005f817e-3e43-49df-bc90-dc094b66fed8 => generated 1315 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:40:42.515706 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-e455a0f5-68f0-4f09-bd3c-de73fd41e225 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:40:42.516431 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-e455a0f5-68f0-4f09-bd3c-de73fd41e225 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] [instance: 005f817e-3e43-49df-bc90-dc094b66fed8] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:40:42.527289 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e455a0f5-68f0-4f09-bd3c-de73fd41e225 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:42.527744 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e455a0f5-68f0-4f09-bd3c-de73fd41e225 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:42.528537 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e455a0f5-68f0-4f09-bd3c-de73fd41e225 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:42.529020 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e455a0f5-68f0-4f09-bd3c-de73fd41e225 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:42.744978 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-e455a0f5-68f0-4f09-bd3c-de73fd41e225 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fbe830d1e74e49a869802f8094be90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a92cc42de224a0290e6328adb1e1924', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:40:42.764486 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-e455a0f5-68f0-4f09-bd3c-de73fd41e225 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] 10.222.0.33 "GET /compute/v2.1/servers/005f817e-3e43-49df-bc90-dc094b66fed8" status: 200 len: 1315 microversion: 2.1 time: 0.243200 Jul 28 05:40:42.776455 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 741/965] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:40:42 2022] GET /compute/v2.1/servers/005f817e-3e43-49df-bc90-dc094b66fed8 => generated 1315 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:40:43.776078 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-29731c32-22ad-422d-8096-be9d338055db tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:40:43.777413 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-29731c32-22ad-422d-8096-be9d338055db tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] [instance: 005f817e-3e43-49df-bc90-dc094b66fed8] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:40:43.779910 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell0:SELECT=2 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:43.780560 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell0:SELECT=8 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:43.786926 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-29731c32-22ad-422d-8096-be9d338055db tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:43.787668 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-29731c32-22ad-422d-8096-be9d338055db tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:43.788630 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-29731c32-22ad-422d-8096-be9d338055db tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:43.789069 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-29731c32-22ad-422d-8096-be9d338055db tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:43.988759 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-29731c32-22ad-422d-8096-be9d338055db tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fbe830d1e74e49a869802f8094be90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a92cc42de224a0290e6328adb1e1924', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:40:43.996465 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-29731c32-22ad-422d-8096-be9d338055db tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] 10.222.0.33 "GET /compute/v2.1/servers/005f817e-3e43-49df-bc90-dc094b66fed8" status: 200 len: 1315 microversion: 2.1 time: 0.224334 Jul 28 05:40:43.997167 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 742/966] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:40:43 2022] GET /compute/v2.1/servers/005f817e-3e43-49df-bc90-dc094b66fed8 => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:40:44.580063 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-fc2b8480-dfb5-4afa-9592-87aac95f4ae0 req-3bbe84e5-1fdd-4110-b33f-79bf23118b2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "005f817e-3e43-49df-bc90-dc094b66fed8", "name": "network-vif-plugged", "status": "completed", "tag": "f719e24b-5b29-4a25-ad02-ca88e9278f7c"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:40:44.598901 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-fc2b8480-dfb5-4afa-9592-87aac95f4ae0 req-3bbe84e5-1fdd-4110-b33f-79bf23118b2a service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:44.599618 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-fc2b8480-dfb5-4afa-9592-87aac95f4ae0 req-3bbe84e5-1fdd-4110-b33f-79bf23118b2a service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:44.624021 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-fc2b8480-dfb5-4afa-9592-87aac95f4ae0 req-3bbe84e5-1fdd-4110-b33f-79bf23118b2a service nova] Creating event network-vif-plugged:f719e24b-5b29-4a25-ad02-ca88e9278f7c for instance 005f817e-3e43-49df-bc90-dc094b66fed8 on hv-cinder-79987 Jul 28 05:40:44.631706 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-fc2b8480-dfb5-4afa-9592-87aac95f4ae0 req-3bbe84e5-1fdd-4110-b33f-79bf23118b2a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055641 Jul 28 05:40:44.635093 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 743/967] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:40:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 05:40:45.019487 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-8fef331d-da8f-44f8-813a-f409cc778075 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:40:45.020192 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-8fef331d-da8f-44f8-813a-f409cc778075 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] [instance: 005f817e-3e43-49df-bc90-dc094b66fed8] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:40:45.026624 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8fef331d-da8f-44f8-813a-f409cc778075 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:45.027325 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8fef331d-da8f-44f8-813a-f409cc778075 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:45.028455 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8fef331d-da8f-44f8-813a-f409cc778075 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:45.028903 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8fef331d-da8f-44f8-813a-f409cc778075 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:45.325432 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-8fef331d-da8f-44f8-813a-f409cc778075 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fbe830d1e74e49a869802f8094be90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a92cc42de224a0290e6328adb1e1924', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:40:45.333639 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-8fef331d-da8f-44f8-813a-f409cc778075 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] 10.222.0.33 "GET /compute/v2.1/servers/005f817e-3e43-49df-bc90-dc094b66fed8" status: 200 len: 1315 microversion: 2.1 time: 0.319264 Jul 28 05:40:45.334392 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 744/968] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:40:45 2022] GET /compute/v2.1/servers/005f817e-3e43-49df-bc90-dc094b66fed8 => generated 1315 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:40:46.358645 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-02203862-547c-416d-9055-d0343e355b24 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:40:46.359378 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-02203862-547c-416d-9055-d0343e355b24 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] [instance: 005f817e-3e43-49df-bc90-dc094b66fed8] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:40:46.367935 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-02203862-547c-416d-9055-d0343e355b24 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:46.369539 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-02203862-547c-416d-9055-d0343e355b24 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:46.370386 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-02203862-547c-416d-9055-d0343e355b24 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:46.370986 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-02203862-547c-416d-9055-d0343e355b24 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:46.523660 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-02203862-547c-416d-9055-d0343e355b24 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fbe830d1e74e49a869802f8094be90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a92cc42de224a0290e6328adb1e1924', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:40:46.532838 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-02203862-547c-416d-9055-d0343e355b24 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] 10.222.0.33 "GET /compute/v2.1/servers/005f817e-3e43-49df-bc90-dc094b66fed8" status: 200 len: 1315 microversion: 2.1 time: 0.178073 Jul 28 05:40:46.533428 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 745/969] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:40:46 2022] GET /compute/v2.1/servers/005f817e-3e43-49df-bc90-dc094b66fed8 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:40:47.557258 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-8f8a9848-f790-4e7d-b8c5-c7bf65f6cc4e tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:40:47.557972 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-8f8a9848-f790-4e7d-b8c5-c7bf65f6cc4e tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] [instance: 005f817e-3e43-49df-bc90-dc094b66fed8] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:40:47.565681 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8f8a9848-f790-4e7d-b8c5-c7bf65f6cc4e tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:47.566286 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8f8a9848-f790-4e7d-b8c5-c7bf65f6cc4e tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:47.567074 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8f8a9848-f790-4e7d-b8c5-c7bf65f6cc4e tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:47.567694 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8f8a9848-f790-4e7d-b8c5-c7bf65f6cc4e tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:47.727618 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-8f8a9848-f790-4e7d-b8c5-c7bf65f6cc4e tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fbe830d1e74e49a869802f8094be90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a92cc42de224a0290e6328adb1e1924', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:40:47.738431 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-8f8a9848-f790-4e7d-b8c5-c7bf65f6cc4e tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] 10.222.0.33 "GET /compute/v2.1/servers/005f817e-3e43-49df-bc90-dc094b66fed8" status: 200 len: 1464 microversion: 2.1 time: 0.185408 Jul 28 05:40:47.739550 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 746/970] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:40:47 2022] GET /compute/v2.1/servers/005f817e-3e43-49df-bc90-dc094b66fed8 => generated 1464 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:40:47.787755 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-4bc4ae71-61e9-4eda-bde0-bacedcd0ad20 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:40:47.788331 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-4bc4ae71-61e9-4eda-bde0-bacedcd0ad20 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] [instance: 005f817e-3e43-49df-bc90-dc094b66fed8] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:40:47.794627 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4bc4ae71-61e9-4eda-bde0-bacedcd0ad20 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:47.795087 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4bc4ae71-61e9-4eda-bde0-bacedcd0ad20 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:47.795856 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4bc4ae71-61e9-4eda-bde0-bacedcd0ad20 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:47.796291 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4bc4ae71-61e9-4eda-bde0-bacedcd0ad20 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:47.822779 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-4bc4ae71-61e9-4eda-bde0-bacedcd0ad20 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] [instance: 005f817e-3e43-49df-bc90-dc094b66fed8] Going to try to terminate instance {{(pid=124482) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 05:40:47.859951 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:48.157336 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-4bc4ae71-61e9-4eda-bde0-bacedcd0ad20 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] 10.222.0.33 "DELETE /compute/v2.1/servers/005f817e-3e43-49df-bc90-dc094b66fed8" status: 204 len: 0 microversion: 2.1 time: 0.373179 Jul 28 05:40:48.161367 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 747/971] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Jul 28 05:40:47 2022] DELETE /compute/v2.1/servers/005f817e-3e43-49df-bc90-dc094b66fed8 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 05:40:48.166995 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-e4e7d143-3a75-4542-8aee-35749345e9fa tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:40:48.167688 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-e4e7d143-3a75-4542-8aee-35749345e9fa tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] [instance: 005f817e-3e43-49df-bc90-dc094b66fed8] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:40:48.174324 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e4e7d143-3a75-4542-8aee-35749345e9fa tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:48.175566 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e4e7d143-3a75-4542-8aee-35749345e9fa tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:48.177520 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e4e7d143-3a75-4542-8aee-35749345e9fa tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:48.178042 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e4e7d143-3a75-4542-8aee-35749345e9fa tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:48.326746 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-e4e7d143-3a75-4542-8aee-35749345e9fa tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fbe830d1e74e49a869802f8094be90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a92cc42de224a0290e6328adb1e1924', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:40:48.337157 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-e4e7d143-3a75-4542-8aee-35749345e9fa tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] 10.222.0.33 "GET /compute/v2.1/servers/005f817e-3e43-49df-bc90-dc094b66fed8" status: 200 len: 1470 microversion: 2.1 time: 0.174433 Jul 28 05:40:48.338348 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 748/972] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:40:48 2022] GET /compute/v2.1/servers/005f817e-3e43-49df-bc90-dc094b66fed8 => generated 1470 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:40:49.359682 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-2018c340-2172-4851-95f6-ced7f89dc319 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:40:49.360320 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-2018c340-2172-4851-95f6-ced7f89dc319 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] [instance: 005f817e-3e43-49df-bc90-dc094b66fed8] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:40:49.369018 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2018c340-2172-4851-95f6-ced7f89dc319 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:49.369767 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2018c340-2172-4851-95f6-ced7f89dc319 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:49.370912 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2018c340-2172-4851-95f6-ced7f89dc319 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:49.371343 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2018c340-2172-4851-95f6-ced7f89dc319 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:49.528752 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-2018c340-2172-4851-95f6-ced7f89dc319 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fbe830d1e74e49a869802f8094be90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a92cc42de224a0290e6328adb1e1924', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:40:49.537844 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-2018c340-2172-4851-95f6-ced7f89dc319 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] 10.222.0.33 "GET /compute/v2.1/servers/005f817e-3e43-49df-bc90-dc094b66fed8" status: 200 len: 1470 microversion: 2.1 time: 0.181842 Jul 28 05:40:49.538791 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 749/973] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:40:49 2022] GET /compute/v2.1/servers/005f817e-3e43-49df-bc90-dc094b66fed8 => generated 1470 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:40:50.560462 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-608c2442-95a7-41d1-9d3d-bb47e983db75 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:40:50.561059 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-608c2442-95a7-41d1-9d3d-bb47e983db75 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] [instance: 005f817e-3e43-49df-bc90-dc094b66fed8] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:40:50.573137 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-608c2442-95a7-41d1-9d3d-bb47e983db75 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:50.573610 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-608c2442-95a7-41d1-9d3d-bb47e983db75 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:50.574383 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-608c2442-95a7-41d1-9d3d-bb47e983db75 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:50.580022 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-608c2442-95a7-41d1-9d3d-bb47e983db75 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:50.741845 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-608c2442-95a7-41d1-9d3d-bb47e983db75 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fbe830d1e74e49a869802f8094be90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a92cc42de224a0290e6328adb1e1924', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:40:50.752423 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-608c2442-95a7-41d1-9d3d-bb47e983db75 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] 10.222.0.33 "GET /compute/v2.1/servers/005f817e-3e43-49df-bc90-dc094b66fed8" status: 200 len: 1428 microversion: 2.1 time: 0.196239 Jul 28 05:40:50.754200 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 750/974] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:40:50 2022] GET /compute/v2.1/servers/005f817e-3e43-49df-bc90-dc094b66fed8 => generated 1428 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:40:50.759198 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-54dd2f6b-83ab-41d3-b9bb-8d95972dfc36 req-633bed7b-af2b-444b-a817-ce8a198779c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "005f817e-3e43-49df-bc90-dc094b66fed8", "name": "network-vif-deleted", "tag": "f719e24b-5b29-4a25-ad02-ca88e9278f7c"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:40:50.770545 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-54dd2f6b-83ab-41d3-b9bb-8d95972dfc36 req-633bed7b-af2b-444b-a817-ce8a198779c9 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:50.771287 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-54dd2f6b-83ab-41d3-b9bb-8d95972dfc36 req-633bed7b-af2b-444b-a817-ce8a198779c9 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:50.789299 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-54dd2f6b-83ab-41d3-b9bb-8d95972dfc36 req-633bed7b-af2b-444b-a817-ce8a198779c9 service nova] Creating event network-vif-deleted:f719e24b-5b29-4a25-ad02-ca88e9278f7c for instance 005f817e-3e43-49df-bc90-dc094b66fed8 on hv-cinder-79987 Jul 28 05:40:50.800844 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-54dd2f6b-83ab-41d3-b9bb-8d95972dfc36 req-633bed7b-af2b-444b-a817-ce8a198779c9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044637 Jul 28 05:40:50.801831 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 751/975] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:40:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:40:51.776610 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-083fad69-6c9d-4a7a-988e-d56ea153f656 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:40:51.777413 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-083fad69-6c9d-4a7a-988e-d56ea153f656 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] [instance: 005f817e-3e43-49df-bc90-dc094b66fed8] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:40:51.787038 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-083fad69-6c9d-4a7a-988e-d56ea153f656 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:51.787038 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-083fad69-6c9d-4a7a-988e-d56ea153f656 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:51.787038 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-083fad69-6c9d-4a7a-988e-d56ea153f656 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:40:51.787038 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-083fad69-6c9d-4a7a-988e-d56ea153f656 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:40:51.803302 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.wsgi [None req-083fad69-6c9d-4a7a-988e-d56ea153f656 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] HTTP exception thrown: Instance 005f817e-3e43-49df-bc90-dc094b66fed8 could not be found. Jul 28 05:40:51.805083 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-083fad69-6c9d-4a7a-988e-d56ea153f656 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Request method failure captured: Jul 28 05:40:51.805083 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: request: GET /compute/v2.1/servers/005f817e-3e43-49df-bc90-dc094b66fed8 HTTP/1.1 Jul 28 05:40:51.805083 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept: application/json Jul 28 05:40:51.805083 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept-Encoding: identity Jul 28 05:40:51.805083 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Connection: close Jul 28 05:40:51.805083 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Length: 0 Jul 28 05:40:51.805083 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Type: application/json Jul 28 05:40:51.805083 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Host: 10.222.0.33 Jul 28 05:40:51.805083 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Openstack-System-Scope: None Jul 28 05:40:51.805083 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: User-Agent: python-urllib3/1.26.10 Jul 28 05:40:51.805083 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Auth-Token: gAAAAABi4iFOz-oVHqLG5fGW0NQSm161VFhBPFUjialDBZPqJ-6KJWZy_541L90bJSpqYmp7EDtNB-xIbEYck_0mtYQc9MDBpGJih55HVRyIDHKA5vdY_BhI6uWBiXyAkDjQ1m88C8EEzIZ_216GZDVo2kY3qgGe7ZahLYfo73h45crcJsMaWkc Jul 28 05:40:51.805083 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Id: None Jul 28 05:40:51.805083 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Name: None Jul 28 05:40:51.805083 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Identity-Status: Confirmed Jul 28 05:40:51.805083 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Is-Admin-Project: True Jul 28 05:40:51.805083 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Id: default Jul 28 05:40:51.805083 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Name: Default Jul 28 05:40:51.805083 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Id: 2a92cc42de224a0290e6328adb1e1924 Jul 28 05:40:51.805083 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Name: tempest-VolumesNegativeTest-1149720515 Jul 28 05:40:51.805083 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Role: member,reader Jul 28 05:40:51.805083 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Roles: member,reader Jul 28 05:40:51.806857 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2a92cc42de224a0290e6328adb1e1924"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2a92cc42de224a0290e6328adb1e1924"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2a92cc42de224a0290e6328adb1e1924", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2a92cc42de224a0290e6328adb1e1924"}]}] Jul 28 05:40:51.806857 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant: tempest-VolumesNegativeTest-1149720515 Jul 28 05:40:51.806857 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Id: 2a92cc42de224a0290e6328adb1e1924 Jul 28 05:40:51.806857 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Name: tempest-VolumesNegativeTest-1149720515 Jul 28 05:40:51.806857 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User: tempest-VolumesNegativeTest-1149720515-project Jul 28 05:40:51.806857 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Id: default Jul 28 05:40:51.806857 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Name: Default Jul 28 05:40:51.806857 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Id: 48fbe830d1e74e49a869802f8094be90 Jul 28 05:40:51.806857 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Name: tempest-VolumesNegativeTest-1149720515-project Jul 28 05:40:51.806857 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: method: > Jul 28 05:40:51.806857 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: exception: Instance 005f817e-3e43-49df-bc90-dc094b66fed8 could not be found. Jul 28 05:40:51.806857 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: action_args: {'id': '005f817e-3e43-49df-bc90-dc094b66fed8'} Jul 28 05:40:51.807858 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 05:40:51.807858 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:40:51.807858 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 05:40:51.807858 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 05:40:51.807858 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 05:40:51.807858 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 05:40:51.807858 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 05:40:51.807858 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 05:40:51.807858 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 05:40:51.807858 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 05:40:51.807858 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 005f817e-3e43-49df-bc90-dc094b66fed8 could not be found. Jul 28 05:40:51.807858 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:40:51.807858 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:40:51.807858 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:40:51.807858 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:40:51.807858 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:40:51.807858 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:40:51.807858 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 05:40:51.807858 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 05:40:51.807858 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 05:40:51.810288 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:40:51.810288 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 05:40:51.810288 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 05:40:51.810288 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 05:40:51.810288 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 05:40:51.810288 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 05:40:51.810288 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 05:40:51.810288 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 005f817e-3e43-49df-bc90-dc094b66fed8 could not be found. Jul 28 05:40:51.810288 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:40:51.810288 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:40:51.810288 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:40:51.810288 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:40:51.810288 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:40:51.810288 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:40:51.810288 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 05:40:51.810288 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 05:40:51.810288 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 005f817e-3e43-49df-bc90-dc094b66fed8 could not be found. Jul 28 05:40:51.810288 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:40:51.811518 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-083fad69-6c9d-4a7a-988e-d56ea153f656 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] Returning 404 to user: Instance 005f817e-3e43-49df-bc90-dc094b66fed8 could not be found. {{(pid=124482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 05:40:51.811518 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-083fad69-6c9d-4a7a-988e-d56ea153f656 tempest-VolumesNegativeTest-1149720515 tempest-VolumesNegativeTest-1149720515-project] 10.222.0.33 "GET /compute/v2.1/servers/005f817e-3e43-49df-bc90-dc094b66fed8" status: 404 len: 111 microversion: 2.1 time: 0.036427 Jul 28 05:40:51.816751 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 752/976] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:40:51 2022] GET /compute/v2.1/servers/005f817e-3e43-49df-bc90-dc094b66fed8 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 05:40:53.226490 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-811c1cef-0e7e-4bb2-9462-b69f9dc7a74a tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Action: 'create', calling method: .version_select at 0x7f25e0261c10>, body: {"keypair": {"name": "tempest-TestShelveInstance-1516733317", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBqF4uCIeDcrWGB3ftFcHAUk/aoaSOWZTB0+8xxP3lsLXEXkQBPZaSyaqrQ7tP3RQxJLPbqjWfDLKJcaPkHZ12udDOW+Fs8iZ2kdVi7FOjxT2axUcfYfpT8RqbGni4xOcg=="}} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:40:53.242940 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.quota [None req-811c1cef-0e7e-4bb2-9462-b69f9dc7a74a tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Getting quotas for project 42f0cd3e66ff4f08bcabdd66f24995ff. Resources: {'key_pairs'} {{(pid=124482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 05:40:53.246767 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.quota [None req-811c1cef-0e7e-4bb2-9462-b69f9dc7a74a tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Getting quotas for user 2d005ca3fb6a40d2850c9d34a5ab7096 and project 42f0cd3e66ff4f08bcabdd66f24995ff. Resources: {'key_pairs'} {{(pid=124482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 05:40:53.327373 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-811c1cef-0e7e-4bb2-9462-b69f9dc7a74a tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.281848 Jul 28 05:40:53.327975 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 753/977] 10.222.0.33 () {60 vars in 1159 bytes} [Thu Jul 28 05:40:53 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 05:41:11.882621 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell1:SELECT=25,nova_cell1:INSERT=1 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:41:11.883390 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell0:SELECT=4 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:41:11.884018 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:41:11.887891 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-d68e7beb-682d-472f-850f-a1760de3a084 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-805176326", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1516733317", "security_groups": [{"name": "tempest-secgroup-smoke-353047855"}], "networks": [{"uuid": "d35a5d75-c1c1-4569-87f3-e51b7895c9f5"}], "block_device_mapping_v2": [{"uuid": "cfa0206e-c9e9-499d-9edf-460b9ad307e0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:41:12.007221 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.network.neutron [None req-d68e7beb-682d-472f-850f-a1760de3a084 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] validate_networks() for [('d35a5d75-c1c1-4569-87f3-e51b7895c9f5', None, None, None, None, None)] {{(pid=124482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 05:41:12.370912 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-d68e7beb-682d-472f-850f-a1760de3a084 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Flavor limits 0:0:0 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 05:41:12.371339 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-d68e7beb-682d-472f-850f-a1760de3a084 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Image limits 0:0:0 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 05:41:12.371812 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-d68e7beb-682d-472f-850f-a1760de3a084 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Flavor pref 0:0:0 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 05:41:12.372219 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-d68e7beb-682d-472f-850f-a1760de3a084 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Image pref 0:0:0 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 05:41:12.372627 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-d68e7beb-682d-472f-850f-a1760de3a084 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 05:41:12.382308 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d68e7beb-682d-472f-850f-a1760de3a084 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:41:12.382755 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d68e7beb-682d-472f-850f-a1760de3a084 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:41:12.383556 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d68e7beb-682d-472f-850f-a1760de3a084 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:41:12.383993 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d68e7beb-682d-472f-850f-a1760de3a084 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:41:12.400544 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.quota [None req-d68e7beb-682d-472f-850f-a1760de3a084 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Getting quotas for project 42f0cd3e66ff4f08bcabdd66f24995ff. Resources: {'ram', 'instances', 'cores'} {{(pid=124482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 05:41:12.404476 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.quota [None req-d68e7beb-682d-472f-850f-a1760de3a084 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Getting quotas for user 2d005ca3fb6a40d2850c9d34a5ab7096 and project 42f0cd3e66ff4f08bcabdd66f24995ff. Resources: {'ram', 'instances', 'cores'} {{(pid=124482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 05:41:12.459887 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-d68e7beb-682d-472f-850f-a1760de3a084 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Going to run 1 instances... {{(pid=124482) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 05:41:12.462074 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-d68e7beb-682d-472f-850f-a1760de3a084 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] [instance: 37d4fabd-fff3-4a2e-8278-a2451c230347] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cfa0206e-c9e9-499d-9edf-460b9ad307e0',volume_size=None,volume_type=None)] {{(pid=124482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 05:41:12.866540 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-d68e7beb-682d-472f-850f-a1760de3a084 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.985497 Jul 28 05:41:12.867462 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 754/978] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Jul 28 05:41:11 2022] POST /compute/v2.1/servers => generated 405 bytes in 988 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 05:41:12.878283 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-750ca594-6715-4d82-a631-bb4bfef3663a tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:41:12.878896 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-750ca594-6715-4d82-a631-bb4bfef3663a tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] [instance: 37d4fabd-fff3-4a2e-8278-a2451c230347] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:41:12.933160 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-750ca594-6715-4d82-a631-bb4bfef3663a tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d005ca3fb6a40d2850c9d34a5ab7096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f0cd3e66ff4f08bcabdd66f24995ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:41:12.940857 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-750ca594-6715-4d82-a631-bb4bfef3663a tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] 10.222.0.33 "GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347" status: 200 len: 1088 microversion: 2.1 time: 0.066253 Jul 28 05:41:12.941497 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 755/979] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:41:12 2022] GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347 => generated 1088 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:41:13.961966 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-2223edc8-f337-48ea-bbc5-d7aa0740a9de tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:41:13.962644 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-2223edc8-f337-48ea-bbc5-d7aa0740a9de tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] [instance: 37d4fabd-fff3-4a2e-8278-a2451c230347] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:41:13.969621 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2223edc8-f337-48ea-bbc5-d7aa0740a9de tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:41:13.970064 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2223edc8-f337-48ea-bbc5-d7aa0740a9de tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:41:13.970865 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2223edc8-f337-48ea-bbc5-d7aa0740a9de tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:41:13.971293 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2223edc8-f337-48ea-bbc5-d7aa0740a9de tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:41:14.030876 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-2223edc8-f337-48ea-bbc5-d7aa0740a9de tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d005ca3fb6a40d2850c9d34a5ab7096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f0cd3e66ff4f08bcabdd66f24995ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:41:14.039004 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-2223edc8-f337-48ea-bbc5-d7aa0740a9de tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] 10.222.0.33 "GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347" status: 200 len: 1138 microversion: 2.1 time: 0.081100 Jul 28 05:41:14.039567 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 756/980] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:41:13 2022] GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347 => generated 1138 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:41:15.059585 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-4089e3f5-f0bd-4e65-87ab-241d63729fac tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:41:15.060348 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-4089e3f5-f0bd-4e65-87ab-241d63729fac tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] [instance: 37d4fabd-fff3-4a2e-8278-a2451c230347] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:41:15.066535 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4089e3f5-f0bd-4e65-87ab-241d63729fac tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:41:15.067295 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4089e3f5-f0bd-4e65-87ab-241d63729fac tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:41:15.068862 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4089e3f5-f0bd-4e65-87ab-241d63729fac tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:41:15.069707 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4089e3f5-f0bd-4e65-87ab-241d63729fac tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:41:15.138051 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-4089e3f5-f0bd-4e65-87ab-241d63729fac tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d005ca3fb6a40d2850c9d34a5ab7096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f0cd3e66ff4f08bcabdd66f24995ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:41:15.145717 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-4089e3f5-f0bd-4e65-87ab-241d63729fac tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] 10.222.0.33 "GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347" status: 200 len: 1204 microversion: 2.1 time: 0.090105 Jul 28 05:41:15.146844 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 757/981] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:41:15 2022] GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347 => generated 1204 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:41:16.168158 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-dc85a48a-ed86-401f-ba6b-05d74a7f392c tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:41:16.168854 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-dc85a48a-ed86-401f-ba6b-05d74a7f392c tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] [instance: 37d4fabd-fff3-4a2e-8278-a2451c230347] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:41:16.175103 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-dc85a48a-ed86-401f-ba6b-05d74a7f392c tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:41:16.175543 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-dc85a48a-ed86-401f-ba6b-05d74a7f392c tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:41:16.176294 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-dc85a48a-ed86-401f-ba6b-05d74a7f392c tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:41:16.176718 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-dc85a48a-ed86-401f-ba6b-05d74a7f392c tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:41:16.335305 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-dc85a48a-ed86-401f-ba6b-05d74a7f392c tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d005ca3fb6a40d2850c9d34a5ab7096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f0cd3e66ff4f08bcabdd66f24995ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:41:16.342820 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-dc85a48a-ed86-401f-ba6b-05d74a7f392c tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] 10.222.0.33 "GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347" status: 200 len: 1271 microversion: 2.1 time: 0.178405 Jul 28 05:41:16.343654 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 758/982] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:41:16 2022] GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347 => generated 1271 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:41:16.530547 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-9aa9b988-f0fd-4cb3-a518-c64a8ef0cd70 req-8db392ae-76cd-43fd-8acb-97055cbaa765 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37d4fabd-fff3-4a2e-8278-a2451c230347", "tag": "dabecf43-c874-4b75-a78a-c55fa1c40977"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:41:16.540557 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-9aa9b988-f0fd-4cb3-a518-c64a8ef0cd70 req-8db392ae-76cd-43fd-8acb-97055cbaa765 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:41:16.541382 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-9aa9b988-f0fd-4cb3-a518-c64a8ef0cd70 req-8db392ae-76cd-43fd-8acb-97055cbaa765 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:41:16.553732 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-9aa9b988-f0fd-4cb3-a518-c64a8ef0cd70 req-8db392ae-76cd-43fd-8acb-97055cbaa765 service nova] Creating event network-changed:dabecf43-c874-4b75-a78a-c55fa1c40977 for instance 37d4fabd-fff3-4a2e-8278-a2451c230347 on hv-cinder-79987 Jul 28 05:41:16.559627 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-9aa9b988-f0fd-4cb3-a518-c64a8ef0cd70 req-8db392ae-76cd-43fd-8acb-97055cbaa765 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032642 Jul 28 05:41:16.560226 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 759/983] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:41:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 05:41:17.365684 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-34012f97-7261-4713-8653-2fd80c251711 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:41:17.366379 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-34012f97-7261-4713-8653-2fd80c251711 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] [instance: 37d4fabd-fff3-4a2e-8278-a2451c230347] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:41:17.372585 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-34012f97-7261-4713-8653-2fd80c251711 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:41:17.373035 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-34012f97-7261-4713-8653-2fd80c251711 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:41:17.373826 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-34012f97-7261-4713-8653-2fd80c251711 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:41:17.374267 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-34012f97-7261-4713-8653-2fd80c251711 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:41:17.507254 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-34012f97-7261-4713-8653-2fd80c251711 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d005ca3fb6a40d2850c9d34a5ab7096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f0cd3e66ff4f08bcabdd66f24995ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:41:17.514710 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-34012f97-7261-4713-8653-2fd80c251711 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] 10.222.0.33 "GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347" status: 200 len: 1259 microversion: 2.1 time: 0.154473 Jul 28 05:41:17.515282 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 760/984] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:41:17 2022] GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:41:18.535704 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-f95bb360-28f0-45e1-858f-91dc6bc15167 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:41:18.536307 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-f95bb360-28f0-45e1-858f-91dc6bc15167 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] [instance: 37d4fabd-fff3-4a2e-8278-a2451c230347] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:41:18.543288 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f95bb360-28f0-45e1-858f-91dc6bc15167 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:41:18.543823 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f95bb360-28f0-45e1-858f-91dc6bc15167 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:41:18.544569 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f95bb360-28f0-45e1-858f-91dc6bc15167 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:41:18.545023 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f95bb360-28f0-45e1-858f-91dc6bc15167 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:41:18.674486 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-f95bb360-28f0-45e1-858f-91dc6bc15167 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d005ca3fb6a40d2850c9d34a5ab7096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f0cd3e66ff4f08bcabdd66f24995ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:41:18.682572 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-f95bb360-28f0-45e1-858f-91dc6bc15167 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] 10.222.0.33 "GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347" status: 200 len: 1259 microversion: 2.1 time: 0.150770 Jul 28 05:41:18.683141 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 761/985] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:41:18 2022] GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:41:19.703525 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-2e6d5572-0f59-4bfe-9688-263d9866e0ab tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:41:19.704158 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-2e6d5572-0f59-4bfe-9688-263d9866e0ab tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] [instance: 37d4fabd-fff3-4a2e-8278-a2451c230347] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:41:19.710634 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2e6d5572-0f59-4bfe-9688-263d9866e0ab tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:41:19.711077 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2e6d5572-0f59-4bfe-9688-263d9866e0ab tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:41:19.711825 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2e6d5572-0f59-4bfe-9688-263d9866e0ab tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:41:19.712261 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2e6d5572-0f59-4bfe-9688-263d9866e0ab tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:41:19.841629 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-2e6d5572-0f59-4bfe-9688-263d9866e0ab tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d005ca3fb6a40d2850c9d34a5ab7096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f0cd3e66ff4f08bcabdd66f24995ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:41:19.848942 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-2e6d5572-0f59-4bfe-9688-263d9866e0ab tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] 10.222.0.33 "GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347" status: 200 len: 1259 microversion: 2.1 time: 0.149358 Jul 28 05:41:19.849700 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 762/986] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:41:19 2022] GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347 => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:41:20.868973 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-24b5c7cc-1c31-4556-b051-7ed8bf86d21c tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:41:20.869653 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-24b5c7cc-1c31-4556-b051-7ed8bf86d21c tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] [instance: 37d4fabd-fff3-4a2e-8278-a2451c230347] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:41:20.876082 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-24b5c7cc-1c31-4556-b051-7ed8bf86d21c tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:41:20.876531 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-24b5c7cc-1c31-4556-b051-7ed8bf86d21c tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:41:20.877283 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-24b5c7cc-1c31-4556-b051-7ed8bf86d21c tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:41:20.877748 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-24b5c7cc-1c31-4556-b051-7ed8bf86d21c tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:41:21.009621 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-24b5c7cc-1c31-4556-b051-7ed8bf86d21c tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d005ca3fb6a40d2850c9d34a5ab7096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f0cd3e66ff4f08bcabdd66f24995ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:41:21.017248 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-24b5c7cc-1c31-4556-b051-7ed8bf86d21c tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] 10.222.0.33 "GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347" status: 200 len: 1259 microversion: 2.1 time: 0.151888 Jul 28 05:41:21.017856 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 763/987] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:41:20 2022] GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:41:22.039657 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-942862bf-a207-496e-a449-1f3feb12675f tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:41:22.040333 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-942862bf-a207-496e-a449-1f3feb12675f tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] [instance: 37d4fabd-fff3-4a2e-8278-a2451c230347] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:41:22.046800 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-942862bf-a207-496e-a449-1f3feb12675f tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:41:22.047244 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-942862bf-a207-496e-a449-1f3feb12675f tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:41:22.048004 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-942862bf-a207-496e-a449-1f3feb12675f tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:41:22.048475 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-942862bf-a207-496e-a449-1f3feb12675f tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:41:22.179763 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-942862bf-a207-496e-a449-1f3feb12675f tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d005ca3fb6a40d2850c9d34a5ab7096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f0cd3e66ff4f08bcabdd66f24995ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:41:22.187190 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-942862bf-a207-496e-a449-1f3feb12675f tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] 10.222.0.33 "GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347" status: 200 len: 1259 microversion: 2.1 time: 0.152099 Jul 28 05:41:22.187759 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 764/988] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:41:22 2022] GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:41:23.207750 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-d7ef64d3-0701-47f4-a2d2-f940ebd3bb84 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:41:23.208418 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-d7ef64d3-0701-47f4-a2d2-f940ebd3bb84 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] [instance: 37d4fabd-fff3-4a2e-8278-a2451c230347] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:41:23.210433 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell0:SELECT=2 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:41:23.211189 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell0:SELECT=8 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:41:23.216373 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d7ef64d3-0701-47f4-a2d2-f940ebd3bb84 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:41:23.216810 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d7ef64d3-0701-47f4-a2d2-f940ebd3bb84 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:41:23.217752 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d7ef64d3-0701-47f4-a2d2-f940ebd3bb84 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:41:23.218001 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d7ef64d3-0701-47f4-a2d2-f940ebd3bb84 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:41:23.352867 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-d7ef64d3-0701-47f4-a2d2-f940ebd3bb84 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d005ca3fb6a40d2850c9d34a5ab7096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f0cd3e66ff4f08bcabdd66f24995ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:41:23.360907 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-d7ef64d3-0701-47f4-a2d2-f940ebd3bb84 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] 10.222.0.33 "GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347" status: 200 len: 1259 microversion: 2.1 time: 0.157002 Jul 28 05:41:23.361479 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 765/989] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:41:23 2022] GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:41:24.382635 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-96f7e202-b41f-457f-8c22-4ee523a0aa31 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:41:24.383238 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-96f7e202-b41f-457f-8c22-4ee523a0aa31 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] [instance: 37d4fabd-fff3-4a2e-8278-a2451c230347] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:41:24.389697 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-96f7e202-b41f-457f-8c22-4ee523a0aa31 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:41:24.390075 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-96f7e202-b41f-457f-8c22-4ee523a0aa31 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:41:24.390820 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-96f7e202-b41f-457f-8c22-4ee523a0aa31 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:41:24.391247 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-96f7e202-b41f-457f-8c22-4ee523a0aa31 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:41:24.519510 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-96f7e202-b41f-457f-8c22-4ee523a0aa31 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d005ca3fb6a40d2850c9d34a5ab7096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f0cd3e66ff4f08bcabdd66f24995ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:41:24.527542 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-96f7e202-b41f-457f-8c22-4ee523a0aa31 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] 10.222.0.33 "GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347" status: 200 len: 1259 microversion: 2.1 time: 0.149376 Jul 28 05:41:24.528117 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 766/990] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:41:24 2022] GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347 => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:41:25.548711 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-4086735b-86f8-410b-b333-7da90f382916 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:41:25.549398 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-4086735b-86f8-410b-b333-7da90f382916 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] [instance: 37d4fabd-fff3-4a2e-8278-a2451c230347] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:41:25.556006 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4086735b-86f8-410b-b333-7da90f382916 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:41:25.556450 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4086735b-86f8-410b-b333-7da90f382916 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:41:25.557214 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4086735b-86f8-410b-b333-7da90f382916 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:41:25.557705 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4086735b-86f8-410b-b333-7da90f382916 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:41:25.844893 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-4086735b-86f8-410b-b333-7da90f382916 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d005ca3fb6a40d2850c9d34a5ab7096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f0cd3e66ff4f08bcabdd66f24995ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:41:25.852270 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-4086735b-86f8-410b-b333-7da90f382916 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] 10.222.0.33 "GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347" status: 200 len: 1259 microversion: 2.1 time: 0.307499 Jul 28 05:41:25.852836 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 767/991] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:41:25 2022] GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347 => generated 1259 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:41:26.874748 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-8ec24ed5-2f9d-45cf-a7d9-672bf51b711f tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:41:26.875360 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-8ec24ed5-2f9d-45cf-a7d9-672bf51b711f tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] [instance: 37d4fabd-fff3-4a2e-8278-a2451c230347] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:41:26.881948 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8ec24ed5-2f9d-45cf-a7d9-672bf51b711f tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:41:26.882401 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8ec24ed5-2f9d-45cf-a7d9-672bf51b711f tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:41:26.883167 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8ec24ed5-2f9d-45cf-a7d9-672bf51b711f tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:41:26.883601 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8ec24ed5-2f9d-45cf-a7d9-672bf51b711f tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:41:27.019282 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-8ec24ed5-2f9d-45cf-a7d9-672bf51b711f tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d005ca3fb6a40d2850c9d34a5ab7096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f0cd3e66ff4f08bcabdd66f24995ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:41:27.027008 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-8ec24ed5-2f9d-45cf-a7d9-672bf51b711f tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] 10.222.0.33 "GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347" status: 200 len: 1259 microversion: 2.1 time: 0.156229 Jul 28 05:41:27.027810 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 768/992] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:41:26 2022] GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:41:28.048141 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-71eb0f9f-ae28-43aa-bdf6-daab8047e58b tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:41:28.048809 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-71eb0f9f-ae28-43aa-bdf6-daab8047e58b tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] [instance: 37d4fabd-fff3-4a2e-8278-a2451c230347] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:41:28.055859 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-71eb0f9f-ae28-43aa-bdf6-daab8047e58b tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:41:28.056310 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-71eb0f9f-ae28-43aa-bdf6-daab8047e58b tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:41:28.057103 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-71eb0f9f-ae28-43aa-bdf6-daab8047e58b tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:41:28.057569 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-71eb0f9f-ae28-43aa-bdf6-daab8047e58b tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:41:28.187326 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-71eb0f9f-ae28-43aa-bdf6-daab8047e58b tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d005ca3fb6a40d2850c9d34a5ab7096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f0cd3e66ff4f08bcabdd66f24995ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:41:28.195308 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-71eb0f9f-ae28-43aa-bdf6-daab8047e58b tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] 10.222.0.33 "GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347" status: 200 len: 1259 microversion: 2.1 time: 0.151106 Jul 28 05:41:28.195867 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 769/993] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:41:28 2022] GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:41:28.633442 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-7c8bbd76-c4da-49c8-89e9-bcf959245ac9 req-c1efcd40-5465-436e-8615-cb98712b0dd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37d4fabd-fff3-4a2e-8278-a2451c230347", "name": "network-vif-plugged", "status": "completed", "tag": "dabecf43-c874-4b75-a78a-c55fa1c40977"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:41:28.643323 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-7c8bbd76-c4da-49c8-89e9-bcf959245ac9 req-c1efcd40-5465-436e-8615-cb98712b0dd5 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:41:28.643767 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-7c8bbd76-c4da-49c8-89e9-bcf959245ac9 req-c1efcd40-5465-436e-8615-cb98712b0dd5 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:41:28.654853 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-7c8bbd76-c4da-49c8-89e9-bcf959245ac9 req-c1efcd40-5465-436e-8615-cb98712b0dd5 service nova] Creating event network-vif-plugged:dabecf43-c874-4b75-a78a-c55fa1c40977 for instance 37d4fabd-fff3-4a2e-8278-a2451c230347 on hv-cinder-79987 Jul 28 05:41:28.659924 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-7c8bbd76-c4da-49c8-89e9-bcf959245ac9 req-c1efcd40-5465-436e-8615-cb98712b0dd5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030258 Jul 28 05:41:28.660525 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 770/994] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:41:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 05:41:29.216639 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-7540d4e8-87f2-4e4a-8f2c-9c3e026fac06 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:41:29.217370 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-7540d4e8-87f2-4e4a-8f2c-9c3e026fac06 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] [instance: 37d4fabd-fff3-4a2e-8278-a2451c230347] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:41:29.223624 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7540d4e8-87f2-4e4a-8f2c-9c3e026fac06 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:41:29.224298 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7540d4e8-87f2-4e4a-8f2c-9c3e026fac06 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:41:29.225060 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7540d4e8-87f2-4e4a-8f2c-9c3e026fac06 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:41:29.225523 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7540d4e8-87f2-4e4a-8f2c-9c3e026fac06 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:41:29.358786 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-7540d4e8-87f2-4e4a-8f2c-9c3e026fac06 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d005ca3fb6a40d2850c9d34a5ab7096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f0cd3e66ff4f08bcabdd66f24995ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:41:29.366239 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-7540d4e8-87f2-4e4a-8f2c-9c3e026fac06 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] 10.222.0.33 "GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347" status: 200 len: 1259 microversion: 2.1 time: 0.154265 Jul 28 05:41:29.366809 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 771/995] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:41:29 2022] GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:41:30.387222 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-5fd35b64-734d-4ee8-9084-4713a17a1433 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:41:30.387852 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-5fd35b64-734d-4ee8-9084-4713a17a1433 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] [instance: 37d4fabd-fff3-4a2e-8278-a2451c230347] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:41:30.394757 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5fd35b64-734d-4ee8-9084-4713a17a1433 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:41:30.395203 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5fd35b64-734d-4ee8-9084-4713a17a1433 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:41:30.396757 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5fd35b64-734d-4ee8-9084-4713a17a1433 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:41:30.397193 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5fd35b64-734d-4ee8-9084-4713a17a1433 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:41:30.525074 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-5fd35b64-734d-4ee8-9084-4713a17a1433 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d005ca3fb6a40d2850c9d34a5ab7096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f0cd3e66ff4f08bcabdd66f24995ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:41:30.532622 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-5fd35b64-734d-4ee8-9084-4713a17a1433 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] 10.222.0.33 "GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347" status: 200 len: 1444 microversion: 2.1 time: 0.149344 Jul 28 05:41:30.533181 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 772/996] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:41:30 2022] GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347 => generated 1444 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:41:30.552852 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-d35bee72-1989-4ef9-b09e-cf4a4957650a tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:41:30.553448 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-d35bee72-1989-4ef9-b09e-cf4a4957650a tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] [instance: 37d4fabd-fff3-4a2e-8278-a2451c230347] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:41:30.559382 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d35bee72-1989-4ef9-b09e-cf4a4957650a tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:41:30.559820 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d35bee72-1989-4ef9-b09e-cf4a4957650a tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:41:30.560565 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d35bee72-1989-4ef9-b09e-cf4a4957650a tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:41:30.560991 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d35bee72-1989-4ef9-b09e-cf4a4957650a tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:41:30.579128 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell1:SELECT=100 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:41:30.692435 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-d35bee72-1989-4ef9-b09e-cf4a4957650a tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d005ca3fb6a40d2850c9d34a5ab7096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f0cd3e66ff4f08bcabdd66f24995ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:41:30.700557 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-d35bee72-1989-4ef9-b09e-cf4a4957650a tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] 10.222.0.33 "GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347" status: 200 len: 1444 microversion: 2.1 time: 0.151352 Jul 28 05:41:30.701130 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 773/997] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:41:30 2022] GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347 => generated 1444 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:41:32.639108 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-192df125-8156-45ae-bd20-4b49fc137287 req-0d5839ae-8c41-4040-86f5-4cf936426a8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37d4fabd-fff3-4a2e-8278-a2451c230347", "tag": "dabecf43-c874-4b75-a78a-c55fa1c40977"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:41:32.650401 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-192df125-8156-45ae-bd20-4b49fc137287 req-0d5839ae-8c41-4040-86f5-4cf936426a8d service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:41:32.650837 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-192df125-8156-45ae-bd20-4b49fc137287 req-0d5839ae-8c41-4040-86f5-4cf936426a8d service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:41:32.661885 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-192df125-8156-45ae-bd20-4b49fc137287 req-0d5839ae-8c41-4040-86f5-4cf936426a8d service nova] Creating event network-changed:dabecf43-c874-4b75-a78a-c55fa1c40977 for instance 37d4fabd-fff3-4a2e-8278-a2451c230347 on hv-cinder-79987 Jul 28 05:41:32.666902 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-192df125-8156-45ae-bd20-4b49fc137287 req-0d5839ae-8c41-4040-86f5-4cf936426a8d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031672 Jul 28 05:41:32.667538 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 774/998] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:41:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 05:42:34.675696 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:42:34.676380 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell1:SELECT=4 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:42:34.680806 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-2ace0255-c1c5-46a9-bfdd-6ec35a3322a4 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:42:34.681382 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-2ace0255-c1c5-46a9-bfdd-6ec35a3322a4 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: 72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:42:34.687358 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2ace0255-c1c5-46a9-bfdd-6ec35a3322a4 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:42:34.687798 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2ace0255-c1c5-46a9-bfdd-6ec35a3322a4 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:42:34.688539 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2ace0255-c1c5-46a9-bfdd-6ec35a3322a4 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:42:34.688964 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2ace0255-c1c5-46a9-bfdd-6ec35a3322a4 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:42:34.713096 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-2ace0255-c1c5-46a9-bfdd-6ec35a3322a4 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: 72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18] Going to try to terminate instance {{(pid=124482) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 05:42:35.029347 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-2ace0255-c1c5-46a9-bfdd-6ec35a3322a4 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "DELETE /compute/v2.1/servers/72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18" status: 204 len: 0 microversion: 2.1 time: 0.355866 Jul 28 05:42:35.032714 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 775/999] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Jul 28 05:42:34 2022] DELETE /compute/v2.1/servers/72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 05:42:35.038515 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-4138392a-38a8-467e-baea-6ae77e6dd889 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:42:35.039197 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-4138392a-38a8-467e-baea-6ae77e6dd889 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: 72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:42:35.044942 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4138392a-38a8-467e-baea-6ae77e6dd889 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:42:35.045382 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4138392a-38a8-467e-baea-6ae77e6dd889 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:42:35.046164 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4138392a-38a8-467e-baea-6ae77e6dd889 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:42:35.046591 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4138392a-38a8-467e-baea-6ae77e6dd889 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:42:35.181326 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-4138392a-38a8-467e-baea-6ae77e6dd889 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09217832f8e74db38d990d25faee4305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049ba77de43b4702832529d687f5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:42:35.188755 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-4138392a-38a8-467e-baea-6ae77e6dd889 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "GET /compute/v2.1/servers/72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18" status: 200 len: 1577 microversion: 2.1 time: 0.154437 Jul 28 05:42:35.189314 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 776/1000] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:42:35 2022] GET /compute/v2.1/servers/72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18 => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:42:36.211223 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-e57a13ef-d8f1-4e30-97bc-66128066bf59 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:42:36.211849 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-e57a13ef-d8f1-4e30-97bc-66128066bf59 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: 72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:42:36.218437 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e57a13ef-d8f1-4e30-97bc-66128066bf59 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:42:36.219092 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e57a13ef-d8f1-4e30-97bc-66128066bf59 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:42:36.219715 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e57a13ef-d8f1-4e30-97bc-66128066bf59 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:42:36.220146 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-e57a13ef-d8f1-4e30-97bc-66128066bf59 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:42:36.348349 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-e57a13ef-d8f1-4e30-97bc-66128066bf59 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09217832f8e74db38d990d25faee4305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049ba77de43b4702832529d687f5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:42:36.356732 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-e57a13ef-d8f1-4e30-97bc-66128066bf59 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "GET /compute/v2.1/servers/72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18" status: 200 len: 1577 microversion: 2.1 time: 0.150124 Jul 28 05:42:36.357547 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 777/1001] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:42:36 2022] GET /compute/v2.1/servers/72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18 => generated 1577 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:42:37.378002 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-0dd4d467-b4b5-46ea-bb44-b33763c649bb tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:42:37.378725 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-0dd4d467-b4b5-46ea-bb44-b33763c649bb tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: 72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:42:37.385221 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-0dd4d467-b4b5-46ea-bb44-b33763c649bb tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:42:37.385699 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-0dd4d467-b4b5-46ea-bb44-b33763c649bb tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:42:37.386455 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-0dd4d467-b4b5-46ea-bb44-b33763c649bb tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:42:37.386882 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-0dd4d467-b4b5-46ea-bb44-b33763c649bb tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:42:37.453383 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-0dd4d467-b4b5-46ea-bb44-b33763c649bb tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09217832f8e74db38d990d25faee4305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049ba77de43b4702832529d687f5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:42:37.462275 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-0dd4d467-b4b5-46ea-bb44-b33763c649bb tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "GET /compute/v2.1/servers/72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18" status: 200 len: 1511 microversion: 2.1 time: 0.088132 Jul 28 05:42:37.462879 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 778/1002] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:42:37 2022] GET /compute/v2.1/servers/72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18 => generated 1511 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:42:37.533257 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-7a66d517-4ac6-4876-aa7d-2e3f27026b4b req-ff6c28f1-8a0f-49c0-8643-e648d1450545 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18", "name": "network-vif-deleted", "tag": "85e26040-6cb9-426b-976c-2e7e7a1a5ca5"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:42:37.543773 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-7a66d517-4ac6-4876-aa7d-2e3f27026b4b req-ff6c28f1-8a0f-49c0-8643-e648d1450545 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:42:37.547583 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-7a66d517-4ac6-4876-aa7d-2e3f27026b4b req-ff6c28f1-8a0f-49c0-8643-e648d1450545 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:42:37.557887 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-7a66d517-4ac6-4876-aa7d-2e3f27026b4b req-ff6c28f1-8a0f-49c0-8643-e648d1450545 service nova] Creating event network-vif-deleted:85e26040-6cb9-426b-976c-2e7e7a1a5ca5 for instance 72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18 on hv-cinder-79987 Jul 28 05:42:37.563275 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-7a66d517-4ac6-4876-aa7d-2e3f27026b4b req-ff6c28f1-8a0f-49c0-8643-e648d1450545 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099263 Jul 28 05:42:37.564084 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 779/1003] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:42:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:42:38.485073 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-65f74462-aa74-4245-a25b-1fea6b85dba3 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:42:38.485871 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-65f74462-aa74-4245-a25b-1fea6b85dba3 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: 72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:42:38.492451 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-65f74462-aa74-4245-a25b-1fea6b85dba3 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:42:38.492887 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-65f74462-aa74-4245-a25b-1fea6b85dba3 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:42:38.493657 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-65f74462-aa74-4245-a25b-1fea6b85dba3 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:42:38.494093 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-65f74462-aa74-4245-a25b-1fea6b85dba3 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:42:38.524045 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-65f74462-aa74-4245-a25b-1fea6b85dba3 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:42:38.524484 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-65f74462-aa74-4245-a25b-1fea6b85dba3 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:42:38.524924 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.objects.instance [None req-65f74462-aa74-4245-a25b-1fea6b85dba3 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lazy-loading 'fault' on Instance uuid 72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18 {{(pid=124482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 05:42:38.576263 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-65f74462-aa74-4245-a25b-1fea6b85dba3 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09217832f8e74db38d990d25faee4305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049ba77de43b4702832529d687f5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:42:38.584861 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-65f74462-aa74-4245-a25b-1fea6b85dba3 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "GET /compute/v2.1/servers/72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18" status: 200 len: 1230 microversion: 2.1 time: 0.104321 Jul 28 05:42:38.585907 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 780/1004] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:42:38 2022] GET /compute/v2.1/servers/72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18 => generated 1230 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:42:39.607131 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-b1748afb-36ea-4d7e-8d51-39f59f07a0e3 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:42:39.607813 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-b1748afb-36ea-4d7e-8d51-39f59f07a0e3 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: 72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:42:39.614273 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b1748afb-36ea-4d7e-8d51-39f59f07a0e3 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:42:39.614725 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b1748afb-36ea-4d7e-8d51-39f59f07a0e3 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:42:39.615475 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b1748afb-36ea-4d7e-8d51-39f59f07a0e3 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:42:39.616531 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b1748afb-36ea-4d7e-8d51-39f59f07a0e3 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:42:39.629663 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.wsgi [None req-b1748afb-36ea-4d7e-8d51-39f59f07a0e3 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] HTTP exception thrown: Instance 72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18 could not be found. Jul 28 05:42:39.631274 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-b1748afb-36ea-4d7e-8d51-39f59f07a0e3 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Request method failure captured: Jul 28 05:42:39.631274 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: request: GET /compute/v2.1/servers/72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18 HTTP/1.1 Jul 28 05:42:39.631274 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept: application/json Jul 28 05:42:39.631274 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept-Encoding: identity Jul 28 05:42:39.631274 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Connection: close Jul 28 05:42:39.631274 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Length: 0 Jul 28 05:42:39.631274 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Type: application/json Jul 28 05:42:39.631274 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Host: 10.222.0.33 Jul 28 05:42:39.631274 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Openstack-System-Scope: None Jul 28 05:42:39.631274 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: User-Agent: python-urllib3/1.26.10 Jul 28 05:42:39.631274 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Auth-Token: gAAAAABi4iEUo10EjyAiud_HlyChWASyUX53ZLs3bgD62XMeHj1VqA0lRf7jrNh3T0aAZ5wTRe5tWSLfiJxJdbXzkIEiKWbrjbQ8IpmbYJbAEVE0ubJjmJBSpi2IwOVOQrh4CbPbW6q1MQrZtCWhkLk1sbnuwe5TQw4-WijLZSbY2qEMOhK2mWs Jul 28 05:42:39.631274 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Id: None Jul 28 05:42:39.631274 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Name: None Jul 28 05:42:39.631274 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Identity-Status: Confirmed Jul 28 05:42:39.631274 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Is-Admin-Project: True Jul 28 05:42:39.631274 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Id: default Jul 28 05:42:39.631274 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Name: Default Jul 28 05:42:39.631274 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Id: 049ba77de43b4702832529d687f5f7a3 Jul 28 05:42:39.631274 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Name: tempest-TestVolumeBootPattern-1858841219 Jul 28 05:42:39.631274 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Role: member,reader Jul 28 05:42:39.631274 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Roles: member,reader Jul 28 05:42:39.632824 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/049ba77de43b4702832529d687f5f7a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/049ba77de43b4702832529d687f5f7a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_049ba77de43b4702832529d687f5f7a3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/049ba77de43b4702832529d687f5f7a3"}]}] Jul 28 05:42:39.632824 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant: tempest-TestVolumeBootPattern-1858841219 Jul 28 05:42:39.632824 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Id: 049ba77de43b4702832529d687f5f7a3 Jul 28 05:42:39.632824 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Name: tempest-TestVolumeBootPattern-1858841219 Jul 28 05:42:39.632824 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User: tempest-TestVolumeBootPattern-1858841219-project Jul 28 05:42:39.632824 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Id: default Jul 28 05:42:39.632824 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Name: Default Jul 28 05:42:39.632824 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Id: 09217832f8e74db38d990d25faee4305 Jul 28 05:42:39.632824 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Name: tempest-TestVolumeBootPattern-1858841219-project Jul 28 05:42:39.632824 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: method: > Jul 28 05:42:39.632824 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: exception: Instance 72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18 could not be found. Jul 28 05:42:39.632824 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: action_args: {'id': '72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18'} Jul 28 05:42:39.633740 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 05:42:39.633740 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:42:39.633740 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 05:42:39.633740 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 05:42:39.633740 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 05:42:39.633740 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 05:42:39.633740 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 05:42:39.633740 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 05:42:39.633740 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 05:42:39.633740 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 05:42:39.633740 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18 could not be found. Jul 28 05:42:39.633740 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:42:39.633740 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:42:39.633740 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:42:39.633740 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:42:39.633740 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:42:39.633740 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:42:39.633740 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 05:42:39.633740 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 05:42:39.633740 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 05:42:39.635054 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:42:39.635054 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 05:42:39.635054 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 05:42:39.635054 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 05:42:39.635054 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 05:42:39.635054 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 05:42:39.635054 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 05:42:39.635054 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18 could not be found. Jul 28 05:42:39.635054 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:42:39.635054 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:42:39.635054 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:42:39.635054 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:42:39.635054 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:42:39.635054 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:42:39.635054 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 05:42:39.635054 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 05:42:39.635054 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18 could not be found. Jul 28 05:42:39.635054 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:42:39.636318 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-b1748afb-36ea-4d7e-8d51-39f59f07a0e3 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Returning 404 to user: Instance 72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18 could not be found. {{(pid=124482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 05:42:39.636318 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-b1748afb-36ea-4d7e-8d51-39f59f07a0e3 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "GET /compute/v2.1/servers/72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18" status: 404 len: 111 microversion: 2.1 time: 0.029587 Jul 28 05:42:39.636318 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 781/1005] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:42:39 2022] GET /compute/v2.1/servers/72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 05:42:39.728516 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-0df68165-aa90-4799-a8ca-4eb2dff59077 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-189147663", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-394088638", "security_groups": [{"name": "tempest-secgroup-smoke-88218149"}], "block_device_mapping_v2": [{"uuid": "84818220-abd2-4100-99bd-e3f2d8a8ae3a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5edb77fb-18f0-41c1-85ec-83f10d2e2f1e"}]}} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:42:39.839873 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.network.neutron [None req-0df68165-aa90-4799-a8ca-4eb2dff59077 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] validate_networks() for [('5edb77fb-18f0-41c1-85ec-83f10d2e2f1e', None, None, None, None, None)] {{(pid=124482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 05:42:40.257877 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-0df68165-aa90-4799-a8ca-4eb2dff59077 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Flavor limits 0:0:0 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 05:42:40.258306 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-0df68165-aa90-4799-a8ca-4eb2dff59077 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Image limits 0:0:0 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 05:42:40.258782 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-0df68165-aa90-4799-a8ca-4eb2dff59077 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Flavor pref 0:0:0 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 05:42:40.259315 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-0df68165-aa90-4799-a8ca-4eb2dff59077 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Image pref 0:0:0 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 05:42:40.259734 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-0df68165-aa90-4799-a8ca-4eb2dff59077 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 05:42:40.268998 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-0df68165-aa90-4799-a8ca-4eb2dff59077 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:42:40.269442 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-0df68165-aa90-4799-a8ca-4eb2dff59077 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:42:40.270259 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-0df68165-aa90-4799-a8ca-4eb2dff59077 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:42:40.270697 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-0df68165-aa90-4799-a8ca-4eb2dff59077 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:42:40.287503 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.quota [None req-0df68165-aa90-4799-a8ca-4eb2dff59077 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Getting quotas for project 049ba77de43b4702832529d687f5f7a3. Resources: {'ram', 'instances', 'cores'} {{(pid=124482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 05:42:40.291666 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.quota [None req-0df68165-aa90-4799-a8ca-4eb2dff59077 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Getting quotas for user 09217832f8e74db38d990d25faee4305 and project 049ba77de43b4702832529d687f5f7a3. Resources: {'ram', 'instances', 'cores'} {{(pid=124482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 05:42:40.347683 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-0df68165-aa90-4799-a8ca-4eb2dff59077 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Going to run 1 instances... {{(pid=124482) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 05:42:40.349814 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-0df68165-aa90-4799-a8ca-4eb2dff59077 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: 1fe47f0f-c147-41c9-aea0-f96143e91d6c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='84818220-abd2-4100-99bd-e3f2d8a8ae3a',volume_size=None,volume_type=None)] {{(pid=124482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 05:42:40.829576 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-0df68165-aa90-4799-a8ca-4eb2dff59077 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.105223 Jul 28 05:42:40.830252 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 782/1006] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Jul 28 05:42:39 2022] POST /compute/v2.1/servers => generated 404 bytes in 1107 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 05:42:40.840450 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-5d3e3d9b-5b4c-4cfe-b823-ca9bcd4e275f tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:42:40.841054 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-5d3e3d9b-5b4c-4cfe-b823-ca9bcd4e275f tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: 1fe47f0f-c147-41c9-aea0-f96143e91d6c] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:42:40.893816 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-5d3e3d9b-5b4c-4cfe-b823-ca9bcd4e275f tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09217832f8e74db38d990d25faee4305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049ba77de43b4702832529d687f5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:42:40.900703 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-5d3e3d9b-5b4c-4cfe-b823-ca9bcd4e275f tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "GET /compute/v2.1/servers/1fe47f0f-c147-41c9-aea0-f96143e91d6c" status: 200 len: 1093 microversion: 2.1 time: 0.063882 Jul 28 05:42:40.901264 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 783/1007] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:42:40 2022] GET /compute/v2.1/servers/1fe47f0f-c147-41c9-aea0-f96143e91d6c => generated 1093 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:42:41.921136 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-420fbc54-1be4-4266-a05c-18df39e8275f tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:42:41.921819 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-420fbc54-1be4-4266-a05c-18df39e8275f tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: 1fe47f0f-c147-41c9-aea0-f96143e91d6c] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:42:41.973933 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-420fbc54-1be4-4266-a05c-18df39e8275f tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09217832f8e74db38d990d25faee4305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049ba77de43b4702832529d687f5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:42:41.982330 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-420fbc54-1be4-4266-a05c-18df39e8275f tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "GET /compute/v2.1/servers/1fe47f0f-c147-41c9-aea0-f96143e91d6c" status: 200 len: 1093 microversion: 2.1 time: 0.064983 Jul 28 05:42:41.982895 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 784/1008] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:42:41 2022] GET /compute/v2.1/servers/1fe47f0f-c147-41c9-aea0-f96143e91d6c => generated 1093 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:42:43.002898 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-5cafc359-8fe8-4f1a-b3fe-f9de072fd958 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:42:43.003552 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-5cafc359-8fe8-4f1a-b3fe-f9de072fd958 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: 1fe47f0f-c147-41c9-aea0-f96143e91d6c] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:42:43.060373 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-5cafc359-8fe8-4f1a-b3fe-f9de072fd958 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09217832f8e74db38d990d25faee4305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049ba77de43b4702832529d687f5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:42:43.067024 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-5cafc359-8fe8-4f1a-b3fe-f9de072fd958 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "GET /compute/v2.1/servers/1fe47f0f-c147-41c9-aea0-f96143e91d6c" status: 200 len: 1093 microversion: 2.1 time: 0.068018 Jul 28 05:42:43.067612 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 785/1009] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:42:42 2022] GET /compute/v2.1/servers/1fe47f0f-c147-41c9-aea0-f96143e91d6c => generated 1093 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:42:44.087063 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-540ed793-ff69-4249-840c-618cd4d23b80 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:42:44.087760 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-540ed793-ff69-4249-840c-618cd4d23b80 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: 1fe47f0f-c147-41c9-aea0-f96143e91d6c] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:42:44.399704 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-540ed793-ff69-4249-840c-618cd4d23b80 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09217832f8e74db38d990d25faee4305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049ba77de43b4702832529d687f5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:42:44.406406 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-540ed793-ff69-4249-840c-618cd4d23b80 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "GET /compute/v2.1/servers/1fe47f0f-c147-41c9-aea0-f96143e91d6c" status: 200 len: 1093 microversion: 2.1 time: 0.323308 Jul 28 05:42:44.406980 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 786/1010] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:42:44 2022] GET /compute/v2.1/servers/1fe47f0f-c147-41c9-aea0-f96143e91d6c => generated 1093 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:42:45.428646 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-4d472367-ef94-4230-acb4-f90371f3e2aa tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:42:45.535413 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-4d472367-ef94-4230-acb4-f90371f3e2aa tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: 1fe47f0f-c147-41c9-aea0-f96143e91d6c] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:42:45.535413 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4d472367-ef94-4230-acb4-f90371f3e2aa tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:42:45.535413 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4d472367-ef94-4230-acb4-f90371f3e2aa tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:42:45.535413 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4d472367-ef94-4230-acb4-f90371f3e2aa tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:42:45.536425 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4d472367-ef94-4230-acb4-f90371f3e2aa tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:42:45.536425 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-4d472367-ef94-4230-acb4-f90371f3e2aa tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09217832f8e74db38d990d25faee4305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049ba77de43b4702832529d687f5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:42:45.536425 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-4d472367-ef94-4230-acb4-f90371f3e2aa tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "GET /compute/v2.1/servers/1fe47f0f-c147-41c9-aea0-f96143e91d6c" status: 200 len: 1143 microversion: 2.1 time: 0.094970 Jul 28 05:42:45.536425 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 787/1011] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:42:45 2022] GET /compute/v2.1/servers/1fe47f0f-c147-41c9-aea0-f96143e91d6c => generated 1143 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:42:46.539466 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-7cc2e277-aab1-40dc-b0f5-c5c572421670 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:42:46.540103 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-7cc2e277-aab1-40dc-b0f5-c5c572421670 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: 1fe47f0f-c147-41c9-aea0-f96143e91d6c] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:42:46.546680 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7cc2e277-aab1-40dc-b0f5-c5c572421670 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:42:46.547181 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7cc2e277-aab1-40dc-b0f5-c5c572421670 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:42:46.547965 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7cc2e277-aab1-40dc-b0f5-c5c572421670 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:42:46.548400 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7cc2e277-aab1-40dc-b0f5-c5c572421670 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:42:46.612526 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-7cc2e277-aab1-40dc-b0f5-c5c572421670 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09217832f8e74db38d990d25faee4305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049ba77de43b4702832529d687f5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:42:46.620713 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-7cc2e277-aab1-40dc-b0f5-c5c572421670 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "GET /compute/v2.1/servers/1fe47f0f-c147-41c9-aea0-f96143e91d6c" status: 200 len: 1191 microversion: 2.1 time: 0.085325 Jul 28 05:42:46.621238 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 788/1012] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:42:46 2022] GET /compute/v2.1/servers/1fe47f0f-c147-41c9-aea0-f96143e91d6c => generated 1191 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:42:47.642714 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-5ca85e5a-2535-415c-bc41-8bb7cf566c8c tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:42:47.643361 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-5ca85e5a-2535-415c-bc41-8bb7cf566c8c tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: 1fe47f0f-c147-41c9-aea0-f96143e91d6c] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:42:47.652542 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5ca85e5a-2535-415c-bc41-8bb7cf566c8c tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:42:47.653132 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5ca85e5a-2535-415c-bc41-8bb7cf566c8c tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:42:47.654019 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5ca85e5a-2535-415c-bc41-8bb7cf566c8c tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:42:47.655127 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5ca85e5a-2535-415c-bc41-8bb7cf566c8c tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:42:47.804318 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-5ca85e5a-2535-415c-bc41-8bb7cf566c8c tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09217832f8e74db38d990d25faee4305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049ba77de43b4702832529d687f5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:42:47.811871 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-5ca85e5a-2535-415c-bc41-8bb7cf566c8c tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "GET /compute/v2.1/servers/1fe47f0f-c147-41c9-aea0-f96143e91d6c" status: 200 len: 1275 microversion: 2.1 time: 0.173491 Jul 28 05:42:47.812436 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 789/1013] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:42:47 2022] GET /compute/v2.1/servers/1fe47f0f-c147-41c9-aea0-f96143e91d6c => generated 1275 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:42:48.512065 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-328411a2-5a4e-4a16-b2a6-56bfee725961 req-8ceff995-e34a-45c1-8d41-063499bea77c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fe47f0f-c147-41c9-aea0-f96143e91d6c", "tag": "84c91d50-101f-41c8-a4a8-e7ece7ef0ce0"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:42:48.522879 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-328411a2-5a4e-4a16-b2a6-56bfee725961 req-8ceff995-e34a-45c1-8d41-063499bea77c service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:42:48.523366 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-328411a2-5a4e-4a16-b2a6-56bfee725961 req-8ceff995-e34a-45c1-8d41-063499bea77c service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:42:48.539886 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-328411a2-5a4e-4a16-b2a6-56bfee725961 req-8ceff995-e34a-45c1-8d41-063499bea77c service nova] Creating event network-changed:84c91d50-101f-41c8-a4a8-e7ece7ef0ce0 for instance 1fe47f0f-c147-41c9-aea0-f96143e91d6c on hv-cinder-79987 Jul 28 05:42:48.545227 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-328411a2-5a4e-4a16-b2a6-56bfee725961 req-8ceff995-e34a-45c1-8d41-063499bea77c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038161 Jul 28 05:42:48.545878 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 790/1014] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:42:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 05:42:48.835224 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-2c72a3fd-5c7c-4f85-a93e-4f0ced557689 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:42:48.835953 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-2c72a3fd-5c7c-4f85-a93e-4f0ced557689 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: 1fe47f0f-c147-41c9-aea0-f96143e91d6c] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:42:48.842258 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2c72a3fd-5c7c-4f85-a93e-4f0ced557689 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:42:48.842697 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2c72a3fd-5c7c-4f85-a93e-4f0ced557689 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:42:48.843453 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2c72a3fd-5c7c-4f85-a93e-4f0ced557689 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:42:48.843881 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2c72a3fd-5c7c-4f85-a93e-4f0ced557689 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:42:48.978912 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-2c72a3fd-5c7c-4f85-a93e-4f0ced557689 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09217832f8e74db38d990d25faee4305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049ba77de43b4702832529d687f5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:42:48.986372 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-2c72a3fd-5c7c-4f85-a93e-4f0ced557689 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "GET /compute/v2.1/servers/1fe47f0f-c147-41c9-aea0-f96143e91d6c" status: 200 len: 1263 microversion: 2.1 time: 0.156380 Jul 28 05:42:48.986945 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 791/1015] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:42:48 2022] GET /compute/v2.1/servers/1fe47f0f-c147-41c9-aea0-f96143e91d6c => generated 1263 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:42:50.007789 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-7cace946-c60a-44fe-9164-f7a409636614 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:42:50.008503 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-7cace946-c60a-44fe-9164-f7a409636614 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: 1fe47f0f-c147-41c9-aea0-f96143e91d6c] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:42:50.014859 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7cace946-c60a-44fe-9164-f7a409636614 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:42:50.015569 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7cace946-c60a-44fe-9164-f7a409636614 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:42:50.016328 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7cace946-c60a-44fe-9164-f7a409636614 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:42:50.016767 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7cace946-c60a-44fe-9164-f7a409636614 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:42:50.146653 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-7cace946-c60a-44fe-9164-f7a409636614 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09217832f8e74db38d990d25faee4305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049ba77de43b4702832529d687f5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:42:50.154203 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-7cace946-c60a-44fe-9164-f7a409636614 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "GET /compute/v2.1/servers/1fe47f0f-c147-41c9-aea0-f96143e91d6c" status: 200 len: 1263 microversion: 2.1 time: 0.150342 Jul 28 05:42:50.154768 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 792/1016] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:42:50 2022] GET /compute/v2.1/servers/1fe47f0f-c147-41c9-aea0-f96143e91d6c => generated 1263 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:42:51.175875 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-2cbefb75-3869-40c6-a33a-b5fad1c5c45d tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:42:51.176517 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-2cbefb75-3869-40c6-a33a-b5fad1c5c45d tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: 1fe47f0f-c147-41c9-aea0-f96143e91d6c] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:42:51.179111 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell0:SELECT=2 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:42:51.184418 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2cbefb75-3869-40c6-a33a-b5fad1c5c45d tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:42:51.184860 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2cbefb75-3869-40c6-a33a-b5fad1c5c45d tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:42:51.185645 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2cbefb75-3869-40c6-a33a-b5fad1c5c45d tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:42:51.186077 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2cbefb75-3869-40c6-a33a-b5fad1c5c45d tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:42:51.316547 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-2cbefb75-3869-40c6-a33a-b5fad1c5c45d tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09217832f8e74db38d990d25faee4305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049ba77de43b4702832529d687f5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:42:51.325008 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-2cbefb75-3869-40c6-a33a-b5fad1c5c45d tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "GET /compute/v2.1/servers/1fe47f0f-c147-41c9-aea0-f96143e91d6c" status: 200 len: 1263 microversion: 2.1 time: 0.153047 Jul 28 05:42:51.325609 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 793/1017] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:42:51 2022] GET /compute/v2.1/servers/1fe47f0f-c147-41c9-aea0-f96143e91d6c => generated 1263 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:42:52.345647 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-1987f249-bfc8-48ee-b115-67c7676945ac tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:42:52.346291 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-1987f249-bfc8-48ee-b115-67c7676945ac tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: 1fe47f0f-c147-41c9-aea0-f96143e91d6c] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:42:52.353518 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1987f249-bfc8-48ee-b115-67c7676945ac tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:42:52.353970 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1987f249-bfc8-48ee-b115-67c7676945ac tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:42:52.354721 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1987f249-bfc8-48ee-b115-67c7676945ac tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:42:52.355153 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1987f249-bfc8-48ee-b115-67c7676945ac tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:42:52.486583 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-1987f249-bfc8-48ee-b115-67c7676945ac tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09217832f8e74db38d990d25faee4305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049ba77de43b4702832529d687f5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:42:52.494663 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-1987f249-bfc8-48ee-b115-67c7676945ac tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "GET /compute/v2.1/servers/1fe47f0f-c147-41c9-aea0-f96143e91d6c" status: 200 len: 1263 microversion: 2.1 time: 0.152852 Jul 28 05:42:52.495232 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 794/1018] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:42:52 2022] GET /compute/v2.1/servers/1fe47f0f-c147-41c9-aea0-f96143e91d6c => generated 1263 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:42:53.515364 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-405fe82c-b695-4e44-b48d-e8ecf55084c9 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:42:53.515999 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-405fe82c-b695-4e44-b48d-e8ecf55084c9 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: 1fe47f0f-c147-41c9-aea0-f96143e91d6c] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:42:53.522986 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-405fe82c-b695-4e44-b48d-e8ecf55084c9 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:42:53.523426 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-405fe82c-b695-4e44-b48d-e8ecf55084c9 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:42:53.524183 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-405fe82c-b695-4e44-b48d-e8ecf55084c9 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:42:53.524614 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-405fe82c-b695-4e44-b48d-e8ecf55084c9 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:42:53.655582 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-405fe82c-b695-4e44-b48d-e8ecf55084c9 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09217832f8e74db38d990d25faee4305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049ba77de43b4702832529d687f5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:42:53.663794 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-405fe82c-b695-4e44-b48d-e8ecf55084c9 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "GET /compute/v2.1/servers/1fe47f0f-c147-41c9-aea0-f96143e91d6c" status: 200 len: 1263 microversion: 2.1 time: 0.152469 Jul 28 05:42:53.664358 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 795/1019] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:42:53 2022] GET /compute/v2.1/servers/1fe47f0f-c147-41c9-aea0-f96143e91d6c => generated 1263 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:42:54.685028 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-a55ae5e4-4ed6-441f-8d55-b56376b017df tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:42:54.685681 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-a55ae5e4-4ed6-441f-8d55-b56376b017df tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: 1fe47f0f-c147-41c9-aea0-f96143e91d6c] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:42:54.687589 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell0:SELECT=14 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:42:54.692772 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a55ae5e4-4ed6-441f-8d55-b56376b017df tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:42:54.693306 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a55ae5e4-4ed6-441f-8d55-b56376b017df tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:42:54.694238 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a55ae5e4-4ed6-441f-8d55-b56376b017df tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:42:54.694650 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a55ae5e4-4ed6-441f-8d55-b56376b017df tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:42:54.698515 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:42:54.824867 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-a55ae5e4-4ed6-441f-8d55-b56376b017df tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09217832f8e74db38d990d25faee4305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049ba77de43b4702832529d687f5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:42:54.832532 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-a55ae5e4-4ed6-441f-8d55-b56376b017df tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "GET /compute/v2.1/servers/1fe47f0f-c147-41c9-aea0-f96143e91d6c" status: 200 len: 1263 microversion: 2.1 time: 0.151426 Jul 28 05:42:54.833099 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 796/1020] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:42:54 2022] GET /compute/v2.1/servers/1fe47f0f-c147-41c9-aea0-f96143e91d6c => generated 1263 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:42:55.853819 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-858aff02-0386-40ce-b593-5ee435279882 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:42:55.854469 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-858aff02-0386-40ce-b593-5ee435279882 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: 1fe47f0f-c147-41c9-aea0-f96143e91d6c] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:42:55.862308 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-858aff02-0386-40ce-b593-5ee435279882 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:42:55.862751 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-858aff02-0386-40ce-b593-5ee435279882 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:42:55.863493 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-858aff02-0386-40ce-b593-5ee435279882 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:42:55.863921 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-858aff02-0386-40ce-b593-5ee435279882 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:42:55.999888 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-858aff02-0386-40ce-b593-5ee435279882 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09217832f8e74db38d990d25faee4305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049ba77de43b4702832529d687f5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:42:56.008093 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-858aff02-0386-40ce-b593-5ee435279882 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "GET /compute/v2.1/servers/1fe47f0f-c147-41c9-aea0-f96143e91d6c" status: 200 len: 1263 microversion: 2.1 time: 0.158289 Jul 28 05:42:56.008662 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 797/1021] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:42:55 2022] GET /compute/v2.1/servers/1fe47f0f-c147-41c9-aea0-f96143e91d6c => generated 1263 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:42:57.029193 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-803f7cf6-653f-49eb-b26b-8fd5cdb17a20 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:42:57.030012 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-803f7cf6-653f-49eb-b26b-8fd5cdb17a20 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: 1fe47f0f-c147-41c9-aea0-f96143e91d6c] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:42:57.036447 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-803f7cf6-653f-49eb-b26b-8fd5cdb17a20 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:42:57.036896 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-803f7cf6-653f-49eb-b26b-8fd5cdb17a20 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:42:57.037699 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-803f7cf6-653f-49eb-b26b-8fd5cdb17a20 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:42:57.038230 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-803f7cf6-653f-49eb-b26b-8fd5cdb17a20 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:42:57.168906 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-803f7cf6-653f-49eb-b26b-8fd5cdb17a20 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09217832f8e74db38d990d25faee4305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049ba77de43b4702832529d687f5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:42:57.176443 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-803f7cf6-653f-49eb-b26b-8fd5cdb17a20 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "GET /compute/v2.1/servers/1fe47f0f-c147-41c9-aea0-f96143e91d6c" status: 200 len: 1263 microversion: 2.1 time: 0.151202 Jul 28 05:42:57.177004 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 798/1022] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:42:57 2022] GET /compute/v2.1/servers/1fe47f0f-c147-41c9-aea0-f96143e91d6c => generated 1263 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:42:58.198603 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-99d7da78-5f74-439e-b2ed-e04576ce2435 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:42:58.199304 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-99d7da78-5f74-439e-b2ed-e04576ce2435 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: 1fe47f0f-c147-41c9-aea0-f96143e91d6c] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:42:58.205624 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-99d7da78-5f74-439e-b2ed-e04576ce2435 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:42:58.206071 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-99d7da78-5f74-439e-b2ed-e04576ce2435 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:42:58.206827 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-99d7da78-5f74-439e-b2ed-e04576ce2435 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:42:58.207264 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-99d7da78-5f74-439e-b2ed-e04576ce2435 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:42:58.339028 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-99d7da78-5f74-439e-b2ed-e04576ce2435 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09217832f8e74db38d990d25faee4305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049ba77de43b4702832529d687f5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:42:58.346467 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-99d7da78-5f74-439e-b2ed-e04576ce2435 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "GET /compute/v2.1/servers/1fe47f0f-c147-41c9-aea0-f96143e91d6c" status: 200 len: 1263 microversion: 2.1 time: 0.152047 Jul 28 05:42:58.347038 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 799/1023] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:42:58 2022] GET /compute/v2.1/servers/1fe47f0f-c147-41c9-aea0-f96143e91d6c => generated 1263 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:42:59.239915 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-91e439be-469d-4766-9763-769bc26caaeb req-2ceeba05-d337-4c6a-b7a9-b16765e56409 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fe47f0f-c147-41c9-aea0-f96143e91d6c", "name": "network-vif-plugged", "status": "completed", "tag": "84c91d50-101f-41c8-a4a8-e7ece7ef0ce0"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:42:59.253183 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-91e439be-469d-4766-9763-769bc26caaeb req-2ceeba05-d337-4c6a-b7a9-b16765e56409 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:42:59.253183 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-91e439be-469d-4766-9763-769bc26caaeb req-2ceeba05-d337-4c6a-b7a9-b16765e56409 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:42:59.261276 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-91e439be-469d-4766-9763-769bc26caaeb req-2ceeba05-d337-4c6a-b7a9-b16765e56409 service nova] Creating event network-vif-plugged:84c91d50-101f-41c8-a4a8-e7ece7ef0ce0 for instance 1fe47f0f-c147-41c9-aea0-f96143e91d6c on hv-cinder-79987 Jul 28 05:42:59.266745 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-91e439be-469d-4766-9763-769bc26caaeb req-2ceeba05-d337-4c6a-b7a9-b16765e56409 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084896 Jul 28 05:42:59.267355 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 800/1024] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:42:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 05:42:59.368814 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-74a1573d-d659-42d0-a67c-9ec67ce974d8 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:42:59.369539 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-74a1573d-d659-42d0-a67c-9ec67ce974d8 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: 1fe47f0f-c147-41c9-aea0-f96143e91d6c] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:42:59.375802 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-74a1573d-d659-42d0-a67c-9ec67ce974d8 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:42:59.379067 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-74a1573d-d659-42d0-a67c-9ec67ce974d8 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:42:59.379067 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-74a1573d-d659-42d0-a67c-9ec67ce974d8 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:42:59.379067 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-74a1573d-d659-42d0-a67c-9ec67ce974d8 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:42:59.513642 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-74a1573d-d659-42d0-a67c-9ec67ce974d8 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09217832f8e74db38d990d25faee4305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049ba77de43b4702832529d687f5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:42:59.521430 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-74a1573d-d659-42d0-a67c-9ec67ce974d8 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "GET /compute/v2.1/servers/1fe47f0f-c147-41c9-aea0-f96143e91d6c" status: 200 len: 1263 microversion: 2.1 time: 0.157269 Jul 28 05:42:59.527290 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 801/1025] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:42:59 2022] GET /compute/v2.1/servers/1fe47f0f-c147-41c9-aea0-f96143e91d6c => generated 1263 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:43:00.550862 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-3f5c0c9e-15ce-4905-96c4-34e81737a8a9 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:43:00.550862 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-3f5c0c9e-15ce-4905-96c4-34e81737a8a9 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: 1fe47f0f-c147-41c9-aea0-f96143e91d6c] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:43:00.550862 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3f5c0c9e-15ce-4905-96c4-34e81737a8a9 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:43:00.550862 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3f5c0c9e-15ce-4905-96c4-34e81737a8a9 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:43:00.551977 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3f5c0c9e-15ce-4905-96c4-34e81737a8a9 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:43:00.551977 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3f5c0c9e-15ce-4905-96c4-34e81737a8a9 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:43:00.684609 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-3f5c0c9e-15ce-4905-96c4-34e81737a8a9 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09217832f8e74db38d990d25faee4305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049ba77de43b4702832529d687f5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:43:00.692417 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-3f5c0c9e-15ce-4905-96c4-34e81737a8a9 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "GET /compute/v2.1/servers/1fe47f0f-c147-41c9-aea0-f96143e91d6c" status: 200 len: 1263 microversion: 2.1 time: 0.153607 Jul 28 05:43:00.692995 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 802/1026] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:43:00 2022] GET /compute/v2.1/servers/1fe47f0f-c147-41c9-aea0-f96143e91d6c => generated 1263 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:43:01.714433 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-c8995e2d-ce1d-439b-b278-b4f4ea8f4c1c tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:43:01.715054 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-c8995e2d-ce1d-439b-b278-b4f4ea8f4c1c tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: 1fe47f0f-c147-41c9-aea0-f96143e91d6c] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:43:01.721586 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c8995e2d-ce1d-439b-b278-b4f4ea8f4c1c tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:43:01.722032 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c8995e2d-ce1d-439b-b278-b4f4ea8f4c1c tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:43:01.722785 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c8995e2d-ce1d-439b-b278-b4f4ea8f4c1c tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:43:01.723223 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c8995e2d-ce1d-439b-b278-b4f4ea8f4c1c tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:43:01.855511 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-c8995e2d-ce1d-439b-b278-b4f4ea8f4c1c tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09217832f8e74db38d990d25faee4305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049ba77de43b4702832529d687f5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:43:01.863022 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-c8995e2d-ce1d-439b-b278-b4f4ea8f4c1c tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "GET /compute/v2.1/servers/1fe47f0f-c147-41c9-aea0-f96143e91d6c" status: 200 len: 1450 microversion: 2.1 time: 0.152544 Jul 28 05:43:01.863587 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 803/1027] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:43:01 2022] GET /compute/v2.1/servers/1fe47f0f-c147-41c9-aea0-f96143e91d6c => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:43:01.882882 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-2c031db9-b4c0-4fc6-82d7-3fb4ba85920d tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:43:01.883487 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-2c031db9-b4c0-4fc6-82d7-3fb4ba85920d tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: 1fe47f0f-c147-41c9-aea0-f96143e91d6c] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:43:01.889232 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2c031db9-b4c0-4fc6-82d7-3fb4ba85920d tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:43:01.889732 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2c031db9-b4c0-4fc6-82d7-3fb4ba85920d tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:43:01.890755 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2c031db9-b4c0-4fc6-82d7-3fb4ba85920d tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:43:01.891189 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2c031db9-b4c0-4fc6-82d7-3fb4ba85920d tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:43:02.018394 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-2c031db9-b4c0-4fc6-82d7-3fb4ba85920d tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09217832f8e74db38d990d25faee4305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049ba77de43b4702832529d687f5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:43:02.026530 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-2c031db9-b4c0-4fc6-82d7-3fb4ba85920d tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "GET /compute/v2.1/servers/1fe47f0f-c147-41c9-aea0-f96143e91d6c" status: 200 len: 1450 microversion: 2.1 time: 0.147209 Jul 28 05:43:02.027103 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 804/1028] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:43:01 2022] GET /compute/v2.1/servers/1fe47f0f-c147-41c9-aea0-f96143e91d6c => generated 1450 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:43:03.951515 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-74eff634-faf0-4b6c-9371-373061c92b96 req-25c1fe52-80d1-4522-b642-153e3f3b6f06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fe47f0f-c147-41c9-aea0-f96143e91d6c", "tag": "84c91d50-101f-41c8-a4a8-e7ece7ef0ce0"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:43:03.961612 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-74eff634-faf0-4b6c-9371-373061c92b96 req-25c1fe52-80d1-4522-b642-153e3f3b6f06 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:43:03.962053 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-74eff634-faf0-4b6c-9371-373061c92b96 req-25c1fe52-80d1-4522-b642-153e3f3b6f06 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:43:03.972922 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-74eff634-faf0-4b6c-9371-373061c92b96 req-25c1fe52-80d1-4522-b642-153e3f3b6f06 service nova] Creating event network-changed:84c91d50-101f-41c8-a4a8-e7ece7ef0ce0 for instance 1fe47f0f-c147-41c9-aea0-f96143e91d6c on hv-cinder-79987 Jul 28 05:43:03.978715 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-74eff634-faf0-4b6c-9371-373061c92b96 req-25c1fe52-80d1-4522-b642-153e3f3b6f06 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087375 Jul 28 05:43:03.979306 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 805/1029] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:43:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:43:27.993675 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:43:27.994421 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell1:SELECT=50 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:43:27.998546 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-b2cdf2b4-6216-48c0-bee0-90d0da72d95d tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:43:27.999157 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-b2cdf2b4-6216-48c0-bee0-90d0da72d95d tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] [instance: 37d4fabd-fff3-4a2e-8278-a2451c230347] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:43:28.005161 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b2cdf2b4-6216-48c0-bee0-90d0da72d95d tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:43:28.007718 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b2cdf2b4-6216-48c0-bee0-90d0da72d95d tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:43:28.007718 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b2cdf2b4-6216-48c0-bee0-90d0da72d95d tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:43:28.007718 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b2cdf2b4-6216-48c0-bee0-90d0da72d95d tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:43:28.029416 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.objects.instance [None req-b2cdf2b4-6216-48c0-bee0-90d0da72d95d tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lazy-loading 'flavor' on Instance uuid 37d4fabd-fff3-4a2e-8278-a2451c230347 {{(pid=124482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 05:43:28.347037 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-b2cdf2b4-6216-48c0-bee0-90d0da72d95d tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] 10.222.0.33 "POST /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347/action" status: 202 len: 0 microversion: 2.1 time: 0.354730 Jul 28 05:43:28.347619 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 806/1030] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Jul 28 05:43:27 2022] POST /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347/action => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 05:43:28.356102 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-f253277d-e5d2-4175-8e35-69387af97511 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:43:28.357011 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-f253277d-e5d2-4175-8e35-69387af97511 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] [instance: 37d4fabd-fff3-4a2e-8278-a2451c230347] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:43:28.363103 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f253277d-e5d2-4175-8e35-69387af97511 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:43:28.363540 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f253277d-e5d2-4175-8e35-69387af97511 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:43:28.364289 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f253277d-e5d2-4175-8e35-69387af97511 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:43:28.364716 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f253277d-e5d2-4175-8e35-69387af97511 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:43:28.503260 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-f253277d-e5d2-4175-8e35-69387af97511 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d005ca3fb6a40d2850c9d34a5ab7096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f0cd3e66ff4f08bcabdd66f24995ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:43:28.510807 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-f253277d-e5d2-4175-8e35-69387af97511 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] 10.222.0.33 "GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347" status: 200 len: 1569 microversion: 2.1 time: 0.158762 Jul 28 05:43:28.511378 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 807/1031] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:43:28 2022] GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:43:29.533633 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-b25b3b9d-26e8-4b53-92a4-de6507bfb278 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:43:29.534265 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-b25b3b9d-26e8-4b53-92a4-de6507bfb278 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] [instance: 37d4fabd-fff3-4a2e-8278-a2451c230347] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:43:29.540583 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b25b3b9d-26e8-4b53-92a4-de6507bfb278 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:43:29.541044 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b25b3b9d-26e8-4b53-92a4-de6507bfb278 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:43:29.541823 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b25b3b9d-26e8-4b53-92a4-de6507bfb278 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:43:29.542250 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b25b3b9d-26e8-4b53-92a4-de6507bfb278 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:43:29.672374 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-b25b3b9d-26e8-4b53-92a4-de6507bfb278 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d005ca3fb6a40d2850c9d34a5ab7096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f0cd3e66ff4f08bcabdd66f24995ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:43:29.679878 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-b25b3b9d-26e8-4b53-92a4-de6507bfb278 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] 10.222.0.33 "GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347" status: 200 len: 1569 microversion: 2.1 time: 0.150159 Jul 28 05:43:29.680446 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 808/1032] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:43:29 2022] GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:43:30.701016 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-ec7ba5d6-4838-45fd-946c-84e45ac36463 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:43:30.701702 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-ec7ba5d6-4838-45fd-946c-84e45ac36463 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] [instance: 37d4fabd-fff3-4a2e-8278-a2451c230347] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:43:30.707961 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ec7ba5d6-4838-45fd-946c-84e45ac36463 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:43:30.708396 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ec7ba5d6-4838-45fd-946c-84e45ac36463 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:43:30.709142 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ec7ba5d6-4838-45fd-946c-84e45ac36463 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:43:30.709600 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ec7ba5d6-4838-45fd-946c-84e45ac36463 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:43:30.843785 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-ec7ba5d6-4838-45fd-946c-84e45ac36463 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d005ca3fb6a40d2850c9d34a5ab7096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f0cd3e66ff4f08bcabdd66f24995ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:43:30.851472 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-ec7ba5d6-4838-45fd-946c-84e45ac36463 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] 10.222.0.33 "GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347" status: 200 len: 1569 microversion: 2.1 time: 0.154357 Jul 28 05:43:30.852038 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 809/1033] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:43:30 2022] GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:43:31.874321 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-60e2a07c-c24c-40c3-95bc-d1f2117c1fa5 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:43:31.874991 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-60e2a07c-c24c-40c3-95bc-d1f2117c1fa5 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] [instance: 37d4fabd-fff3-4a2e-8278-a2451c230347] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:43:31.881389 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-60e2a07c-c24c-40c3-95bc-d1f2117c1fa5 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:43:31.881866 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-60e2a07c-c24c-40c3-95bc-d1f2117c1fa5 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:43:31.882619 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-60e2a07c-c24c-40c3-95bc-d1f2117c1fa5 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:43:31.883077 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-60e2a07c-c24c-40c3-95bc-d1f2117c1fa5 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:43:32.011211 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-60e2a07c-c24c-40c3-95bc-d1f2117c1fa5 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d005ca3fb6a40d2850c9d34a5ab7096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f0cd3e66ff4f08bcabdd66f24995ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:43:32.019033 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-60e2a07c-c24c-40c3-95bc-d1f2117c1fa5 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] 10.222.0.33 "GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347" status: 200 len: 1569 microversion: 2.1 time: 0.149357 Jul 28 05:43:32.019601 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 810/1034] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:43:31 2022] GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:43:33.039796 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-22cde597-7631-4dc5-8c2c-44c6b266d35a tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:43:33.040433 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-22cde597-7631-4dc5-8c2c-44c6b266d35a tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] [instance: 37d4fabd-fff3-4a2e-8278-a2451c230347] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:43:33.047573 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-22cde597-7631-4dc5-8c2c-44c6b266d35a tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:43:33.048010 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-22cde597-7631-4dc5-8c2c-44c6b266d35a tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:43:33.048753 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-22cde597-7631-4dc5-8c2c-44c6b266d35a tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:43:33.049180 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-22cde597-7631-4dc5-8c2c-44c6b266d35a tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:43:33.177337 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-22cde597-7631-4dc5-8c2c-44c6b266d35a tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d005ca3fb6a40d2850c9d34a5ab7096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f0cd3e66ff4f08bcabdd66f24995ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:43:33.184986 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-22cde597-7631-4dc5-8c2c-44c6b266d35a tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] 10.222.0.33 "GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347" status: 200 len: 1569 microversion: 2.1 time: 0.149072 Jul 28 05:43:33.185780 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 811/1035] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:43:33 2022] GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:43:34.206203 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-08825853-e999-4421-bbe4-4f8355b8d2f7 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:43:34.206882 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-08825853-e999-4421-bbe4-4f8355b8d2f7 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] [instance: 37d4fabd-fff3-4a2e-8278-a2451c230347] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:43:34.212790 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-08825853-e999-4421-bbe4-4f8355b8d2f7 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:43:34.213230 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-08825853-e999-4421-bbe4-4f8355b8d2f7 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:43:34.214001 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-08825853-e999-4421-bbe4-4f8355b8d2f7 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:43:34.214427 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-08825853-e999-4421-bbe4-4f8355b8d2f7 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:43:34.347010 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-08825853-e999-4421-bbe4-4f8355b8d2f7 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d005ca3fb6a40d2850c9d34a5ab7096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f0cd3e66ff4f08bcabdd66f24995ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:43:34.354492 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-08825853-e999-4421-bbe4-4f8355b8d2f7 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] 10.222.0.33 "GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347" status: 200 len: 1569 microversion: 2.1 time: 0.152250 Jul 28 05:43:34.355061 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 812/1036] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:43:34 2022] GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:43:35.376880 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-f9387fc8-40f7-4a1d-8dde-1a57fc110d46 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:43:35.377536 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-f9387fc8-40f7-4a1d-8dde-1a57fc110d46 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] [instance: 37d4fabd-fff3-4a2e-8278-a2451c230347] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:43:35.384028 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f9387fc8-40f7-4a1d-8dde-1a57fc110d46 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:43:35.384473 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f9387fc8-40f7-4a1d-8dde-1a57fc110d46 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:43:35.385227 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f9387fc8-40f7-4a1d-8dde-1a57fc110d46 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:43:35.385706 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f9387fc8-40f7-4a1d-8dde-1a57fc110d46 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:43:35.516057 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-f9387fc8-40f7-4a1d-8dde-1a57fc110d46 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d005ca3fb6a40d2850c9d34a5ab7096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f0cd3e66ff4f08bcabdd66f24995ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:43:35.523479 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-f9387fc8-40f7-4a1d-8dde-1a57fc110d46 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] 10.222.0.33 "GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347" status: 200 len: 1569 microversion: 2.1 time: 0.150536 Jul 28 05:43:35.524042 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 813/1037] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:43:35 2022] GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:43:36.544251 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-74c6e175-6ff0-4193-a48f-0e4d96a9eec0 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:43:36.544914 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-74c6e175-6ff0-4193-a48f-0e4d96a9eec0 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] [instance: 37d4fabd-fff3-4a2e-8278-a2451c230347] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:43:36.551567 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-74c6e175-6ff0-4193-a48f-0e4d96a9eec0 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:43:36.552015 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-74c6e175-6ff0-4193-a48f-0e4d96a9eec0 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:43:36.552776 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-74c6e175-6ff0-4193-a48f-0e4d96a9eec0 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:43:36.553210 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-74c6e175-6ff0-4193-a48f-0e4d96a9eec0 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:43:36.685415 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-74c6e175-6ff0-4193-a48f-0e4d96a9eec0 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d005ca3fb6a40d2850c9d34a5ab7096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f0cd3e66ff4f08bcabdd66f24995ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:43:36.692972 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-74c6e175-6ff0-4193-a48f-0e4d96a9eec0 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] 10.222.0.33 "GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347" status: 200 len: 1569 microversion: 2.1 time: 0.152691 Jul 28 05:43:36.693559 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 814/1038] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:43:36 2022] GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:43:37.714505 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-2bee6284-4a29-4776-b5ed-6db77776d221 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:43:37.715187 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-2bee6284-4a29-4776-b5ed-6db77776d221 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] [instance: 37d4fabd-fff3-4a2e-8278-a2451c230347] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:43:37.721827 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2bee6284-4a29-4776-b5ed-6db77776d221 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:43:37.722269 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2bee6284-4a29-4776-b5ed-6db77776d221 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:43:37.723018 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2bee6284-4a29-4776-b5ed-6db77776d221 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:43:37.723443 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2bee6284-4a29-4776-b5ed-6db77776d221 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:43:37.852975 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-2bee6284-4a29-4776-b5ed-6db77776d221 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d005ca3fb6a40d2850c9d34a5ab7096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f0cd3e66ff4f08bcabdd66f24995ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:43:37.860958 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-2bee6284-4a29-4776-b5ed-6db77776d221 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] 10.222.0.33 "GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347" status: 200 len: 1569 microversion: 2.1 time: 0.150240 Jul 28 05:43:37.861545 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 815/1039] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:43:37 2022] GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:43:38.882849 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-849c908a-924d-4686-8cd1-a828ef6de042 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:43:38.883527 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-849c908a-924d-4686-8cd1-a828ef6de042 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] [instance: 37d4fabd-fff3-4a2e-8278-a2451c230347] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:43:38.891077 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-849c908a-924d-4686-8cd1-a828ef6de042 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:43:38.891521 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-849c908a-924d-4686-8cd1-a828ef6de042 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:43:38.892302 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-849c908a-924d-4686-8cd1-a828ef6de042 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:43:38.892729 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-849c908a-924d-4686-8cd1-a828ef6de042 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:43:39.024537 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-849c908a-924d-4686-8cd1-a828ef6de042 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d005ca3fb6a40d2850c9d34a5ab7096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f0cd3e66ff4f08bcabdd66f24995ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:43:39.032346 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-849c908a-924d-4686-8cd1-a828ef6de042 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] 10.222.0.33 "GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347" status: 200 len: 1569 microversion: 2.1 time: 0.153733 Jul 28 05:43:39.032924 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 816/1040] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:43:38 2022] GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:43:40.053409 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-8c96a234-2fe7-43ec-99ca-aa629be450b0 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:43:40.054117 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-8c96a234-2fe7-43ec-99ca-aa629be450b0 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] [instance: 37d4fabd-fff3-4a2e-8278-a2451c230347] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:43:40.060668 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8c96a234-2fe7-43ec-99ca-aa629be450b0 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:43:40.061121 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8c96a234-2fe7-43ec-99ca-aa629be450b0 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:43:40.061908 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8c96a234-2fe7-43ec-99ca-aa629be450b0 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:43:40.062348 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8c96a234-2fe7-43ec-99ca-aa629be450b0 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:43:40.194401 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-8c96a234-2fe7-43ec-99ca-aa629be450b0 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d005ca3fb6a40d2850c9d34a5ab7096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f0cd3e66ff4f08bcabdd66f24995ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:43:40.203095 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-8c96a234-2fe7-43ec-99ca-aa629be450b0 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] 10.222.0.33 "GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347" status: 200 len: 1569 microversion: 2.1 time: 0.153562 Jul 28 05:43:40.203662 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 817/1041] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:43:40 2022] GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:43:41.225728 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-1e8f0c56-fa60-4ca2-937d-2467fca1db0b tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:43:41.226896 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-1e8f0c56-fa60-4ca2-937d-2467fca1db0b tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] [instance: 37d4fabd-fff3-4a2e-8278-a2451c230347] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:43:41.234274 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1e8f0c56-fa60-4ca2-937d-2467fca1db0b tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:43:41.235594 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1e8f0c56-fa60-4ca2-937d-2467fca1db0b tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:43:41.235776 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1e8f0c56-fa60-4ca2-937d-2467fca1db0b tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:43:41.236161 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1e8f0c56-fa60-4ca2-937d-2467fca1db0b tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:43:41.368483 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-1e8f0c56-fa60-4ca2-937d-2467fca1db0b tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d005ca3fb6a40d2850c9d34a5ab7096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f0cd3e66ff4f08bcabdd66f24995ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:43:41.376486 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-1e8f0c56-fa60-4ca2-937d-2467fca1db0b tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] 10.222.0.33 "GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347" status: 200 len: 1569 microversion: 2.1 time: 0.154825 Jul 28 05:43:41.380557 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 818/1042] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:43:41 2022] GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:43:42.397347 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-5d68a4f7-2773-4ec3-8b85-a19074b94c38 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:43:42.398077 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-5d68a4f7-2773-4ec3-8b85-a19074b94c38 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] [instance: 37d4fabd-fff3-4a2e-8278-a2451c230347] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:43:42.404478 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5d68a4f7-2773-4ec3-8b85-a19074b94c38 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:43:42.404991 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5d68a4f7-2773-4ec3-8b85-a19074b94c38 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:43:42.405861 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5d68a4f7-2773-4ec3-8b85-a19074b94c38 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:43:42.406301 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5d68a4f7-2773-4ec3-8b85-a19074b94c38 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:43:42.539616 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-5d68a4f7-2773-4ec3-8b85-a19074b94c38 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d005ca3fb6a40d2850c9d34a5ab7096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f0cd3e66ff4f08bcabdd66f24995ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:43:42.547726 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-5d68a4f7-2773-4ec3-8b85-a19074b94c38 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] 10.222.0.33 "GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347" status: 200 len: 1510 microversion: 2.1 time: 0.154220 Jul 28 05:43:42.548287 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 819/1043] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:43:42 2022] GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347 => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:43:42.568108 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-07b3c742-c080-4813-b5b3-bd2fda8b284c tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:43:42.568694 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-07b3c742-c080-4813-b5b3-bd2fda8b284c tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] [instance: 37d4fabd-fff3-4a2e-8278-a2451c230347] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:43:42.574344 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-07b3c742-c080-4813-b5b3-bd2fda8b284c tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:43:42.574782 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-07b3c742-c080-4813-b5b3-bd2fda8b284c tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:43:42.575522 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-07b3c742-c080-4813-b5b3-bd2fda8b284c tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:43:42.575948 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-07b3c742-c080-4813-b5b3-bd2fda8b284c tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:43:42.591772 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:43:42.603992 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-07b3c742-c080-4813-b5b3-bd2fda8b284c tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] [instance: 37d4fabd-fff3-4a2e-8278-a2451c230347] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124482) unshelve /opt/stack/nova/nova/compute/api.py:4532}} Jul 28 05:43:42.893053 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-07b3c742-c080-4813-b5b3-bd2fda8b284c tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] 10.222.0.33 "POST /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347/action" status: 202 len: 0 microversion: 2.1 time: 0.328322 Jul 28 05:43:42.893871 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 820/1044] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Jul 28 05:43:42 2022] POST /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347/action => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 05:43:42.902339 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-5cf19afe-d0ff-42a8-bcaa-98add46a1fe8 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:43:42.902953 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-5cf19afe-d0ff-42a8-bcaa-98add46a1fe8 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] [instance: 37d4fabd-fff3-4a2e-8278-a2451c230347] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:43:42.909752 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5cf19afe-d0ff-42a8-bcaa-98add46a1fe8 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:43:42.910205 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5cf19afe-d0ff-42a8-bcaa-98add46a1fe8 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:43:42.910984 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5cf19afe-d0ff-42a8-bcaa-98add46a1fe8 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:43:42.911419 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5cf19afe-d0ff-42a8-bcaa-98add46a1fe8 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:43:43.044063 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-5cf19afe-d0ff-42a8-bcaa-98add46a1fe8 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d005ca3fb6a40d2850c9d34a5ab7096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f0cd3e66ff4f08bcabdd66f24995ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:43:43.052503 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-5cf19afe-d0ff-42a8-bcaa-98add46a1fe8 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] 10.222.0.33 "GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347" status: 200 len: 1518 microversion: 2.1 time: 0.153993 Jul 28 05:43:43.053085 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 821/1045] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:43:42 2022] GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347 => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:43:44.074957 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-81157312-2af8-47bb-ba18-213cc1a8f168 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:43:44.075764 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-81157312-2af8-47bb-ba18-213cc1a8f168 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] [instance: 37d4fabd-fff3-4a2e-8278-a2451c230347] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:43:44.082906 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-81157312-2af8-47bb-ba18-213cc1a8f168 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:43:44.083428 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-81157312-2af8-47bb-ba18-213cc1a8f168 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:43:44.084160 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-81157312-2af8-47bb-ba18-213cc1a8f168 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:43:44.084594 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-81157312-2af8-47bb-ba18-213cc1a8f168 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:43:44.219683 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-81157312-2af8-47bb-ba18-213cc1a8f168 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d005ca3fb6a40d2850c9d34a5ab7096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f0cd3e66ff4f08bcabdd66f24995ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:43:44.227329 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-81157312-2af8-47bb-ba18-213cc1a8f168 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] 10.222.0.33 "GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347" status: 200 len: 1518 microversion: 2.1 time: 0.156944 Jul 28 05:43:44.227901 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 822/1046] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:43:44 2022] GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347 => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:43:45.249224 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-474e1436-121c-4f94-b6ba-0a4727cfc935 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:43:45.249901 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-474e1436-121c-4f94-b6ba-0a4727cfc935 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] [instance: 37d4fabd-fff3-4a2e-8278-a2451c230347] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:43:45.256705 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-474e1436-121c-4f94-b6ba-0a4727cfc935 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:43:45.257161 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-474e1436-121c-4f94-b6ba-0a4727cfc935 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:43:45.258061 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-474e1436-121c-4f94-b6ba-0a4727cfc935 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:43:45.258498 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-474e1436-121c-4f94-b6ba-0a4727cfc935 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:43:45.399264 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-474e1436-121c-4f94-b6ba-0a4727cfc935 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d005ca3fb6a40d2850c9d34a5ab7096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f0cd3e66ff4f08bcabdd66f24995ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:43:45.407524 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-474e1436-121c-4f94-b6ba-0a4727cfc935 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] 10.222.0.33 "GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347" status: 200 len: 1520 microversion: 2.1 time: 0.162392 Jul 28 05:43:45.411723 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 823/1047] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:43:45 2022] GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:43:45.430552 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-313ff26b-52d8-4f17-9cb4-390eb5faab08 req-cbe6e2a8-2094-4158-943a-2fa8c3ce474f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37d4fabd-fff3-4a2e-8278-a2451c230347", "name": "network-vif-unplugged", "status": "completed", "tag": "dabecf43-c874-4b75-a78a-c55fa1c40977"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:43:45.440498 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-313ff26b-52d8-4f17-9cb4-390eb5faab08 req-cbe6e2a8-2094-4158-943a-2fa8c3ce474f service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:43:45.440940 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-313ff26b-52d8-4f17-9cb4-390eb5faab08 req-cbe6e2a8-2094-4158-943a-2fa8c3ce474f service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:43:45.452691 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.compute.server_external_events [req-313ff26b-52d8-4f17-9cb4-390eb5faab08 req-cbe6e2a8-2094-4158-943a-2fa8c3ce474f service nova] Unable to find a host for instance 37d4fabd-fff3-4a2e-8278-a2451c230347. Dropping event network-vif-unplugged {{(pid=124482) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 28 05:43:45.453620 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-313ff26b-52d8-4f17-9cb4-390eb5faab08 req-cbe6e2a8-2094-4158-943a-2fa8c3ce474f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027062 Jul 28 05:43:45.454202 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 824/1048] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:43:45 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 28 05:43:46.430561 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-bf65733f-483a-4246-a74a-ecf68eb8a812 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:43:46.436355 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-bf65733f-483a-4246-a74a-ecf68eb8a812 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] [instance: 37d4fabd-fff3-4a2e-8278-a2451c230347] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:43:46.437865 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-bf65733f-483a-4246-a74a-ecf68eb8a812 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:43:46.438308 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-bf65733f-483a-4246-a74a-ecf68eb8a812 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:43:46.439057 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-bf65733f-483a-4246-a74a-ecf68eb8a812 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:43:46.439482 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-bf65733f-483a-4246-a74a-ecf68eb8a812 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:43:46.583710 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-bf65733f-483a-4246-a74a-ecf68eb8a812 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d005ca3fb6a40d2850c9d34a5ab7096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f0cd3e66ff4f08bcabdd66f24995ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:43:46.591115 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-bf65733f-483a-4246-a74a-ecf68eb8a812 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] 10.222.0.33 "GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347" status: 200 len: 1576 microversion: 2.1 time: 0.164343 Jul 28 05:43:46.591692 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 825/1049] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:43:46 2022] GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347 => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:43:47.612689 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-09477adf-cfe7-4cfe-9a77-a37c3cfdedf7 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:43:47.613327 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-09477adf-cfe7-4cfe-9a77-a37c3cfdedf7 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] [instance: 37d4fabd-fff3-4a2e-8278-a2451c230347] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:43:47.619729 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-09477adf-cfe7-4cfe-9a77-a37c3cfdedf7 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:43:47.620176 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-09477adf-cfe7-4cfe-9a77-a37c3cfdedf7 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:43:47.620939 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-09477adf-cfe7-4cfe-9a77-a37c3cfdedf7 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:43:47.621375 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-09477adf-cfe7-4cfe-9a77-a37c3cfdedf7 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:43:47.750289 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-09477adf-cfe7-4cfe-9a77-a37c3cfdedf7 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d005ca3fb6a40d2850c9d34a5ab7096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f0cd3e66ff4f08bcabdd66f24995ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:43:47.757913 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-09477adf-cfe7-4cfe-9a77-a37c3cfdedf7 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] 10.222.0.33 "GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347" status: 200 len: 1576 microversion: 2.1 time: 0.149100 Jul 28 05:43:47.758470 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 826/1050] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:43:47 2022] GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347 => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:43:48.778476 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-a5c34784-98b7-46ba-92bf-c0cc379cf52c tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:43:48.779130 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-a5c34784-98b7-46ba-92bf-c0cc379cf52c tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] [instance: 37d4fabd-fff3-4a2e-8278-a2451c230347] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:43:48.785758 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a5c34784-98b7-46ba-92bf-c0cc379cf52c tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:43:48.786276 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a5c34784-98b7-46ba-92bf-c0cc379cf52c tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:43:48.787036 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a5c34784-98b7-46ba-92bf-c0cc379cf52c tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:43:48.787531 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-a5c34784-98b7-46ba-92bf-c0cc379cf52c tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:43:48.915652 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-a5c34784-98b7-46ba-92bf-c0cc379cf52c tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d005ca3fb6a40d2850c9d34a5ab7096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f0cd3e66ff4f08bcabdd66f24995ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:43:48.923230 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-a5c34784-98b7-46ba-92bf-c0cc379cf52c tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] 10.222.0.33 "GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347" status: 200 len: 1576 microversion: 2.1 time: 0.148613 Jul 28 05:43:48.923802 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 827/1051] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:43:48 2022] GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347 => generated 1576 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:43:49.944373 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-5db55e5a-89e5-4c39-bc2f-5a21f41fd00e tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:43:49.945054 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-5db55e5a-89e5-4c39-bc2f-5a21f41fd00e tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] [instance: 37d4fabd-fff3-4a2e-8278-a2451c230347] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:43:49.952131 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5db55e5a-89e5-4c39-bc2f-5a21f41fd00e tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:43:49.952587 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5db55e5a-89e5-4c39-bc2f-5a21f41fd00e tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:43:49.953333 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5db55e5a-89e5-4c39-bc2f-5a21f41fd00e tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:43:49.953791 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5db55e5a-89e5-4c39-bc2f-5a21f41fd00e tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:43:50.084753 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-5db55e5a-89e5-4c39-bc2f-5a21f41fd00e tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d005ca3fb6a40d2850c9d34a5ab7096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f0cd3e66ff4f08bcabdd66f24995ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:43:50.092154 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-5db55e5a-89e5-4c39-bc2f-5a21f41fd00e tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] 10.222.0.33 "GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347" status: 200 len: 1576 microversion: 2.1 time: 0.151678 Jul 28 05:43:50.092721 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 828/1052] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:43:49 2022] GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:43:51.114422 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-474e5f27-cde6-4519-8b3f-4804715aef75 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:43:51.115098 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-474e5f27-cde6-4519-8b3f-4804715aef75 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] [instance: 37d4fabd-fff3-4a2e-8278-a2451c230347] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:43:51.121366 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-474e5f27-cde6-4519-8b3f-4804715aef75 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:43:51.121819 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-474e5f27-cde6-4519-8b3f-4804715aef75 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:43:51.122558 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-474e5f27-cde6-4519-8b3f-4804715aef75 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:43:51.122994 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-474e5f27-cde6-4519-8b3f-4804715aef75 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:43:51.250147 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-474e5f27-cde6-4519-8b3f-4804715aef75 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d005ca3fb6a40d2850c9d34a5ab7096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f0cd3e66ff4f08bcabdd66f24995ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:43:51.257577 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-474e5f27-cde6-4519-8b3f-4804715aef75 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] 10.222.0.33 "GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347" status: 200 len: 1576 microversion: 2.1 time: 0.146943 Jul 28 05:43:51.258161 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 829/1053] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:43:51 2022] GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347 => generated 1576 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:43:52.279017 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-8a278f82-f312-41f6-8416-04523d8e8868 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:43:52.279676 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-8a278f82-f312-41f6-8416-04523d8e8868 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] [instance: 37d4fabd-fff3-4a2e-8278-a2451c230347] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:43:52.286638 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8a278f82-f312-41f6-8416-04523d8e8868 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:43:52.287088 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8a278f82-f312-41f6-8416-04523d8e8868 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:43:52.287836 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8a278f82-f312-41f6-8416-04523d8e8868 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:43:52.288263 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8a278f82-f312-41f6-8416-04523d8e8868 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:43:52.423715 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-8a278f82-f312-41f6-8416-04523d8e8868 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d005ca3fb6a40d2850c9d34a5ab7096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f0cd3e66ff4f08bcabdd66f24995ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:43:52.431235 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-8a278f82-f312-41f6-8416-04523d8e8868 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] 10.222.0.33 "GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347" status: 200 len: 1576 microversion: 2.1 time: 0.156097 Jul 28 05:43:52.431805 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 830/1054] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:43:52 2022] GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:43:53.452177 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-5e1508d4-1866-4719-af27-4e22d3083bed tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:43:53.452802 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-5e1508d4-1866-4719-af27-4e22d3083bed tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] [instance: 37d4fabd-fff3-4a2e-8278-a2451c230347] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:43:53.459270 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5e1508d4-1866-4719-af27-4e22d3083bed tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:43:53.459714 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5e1508d4-1866-4719-af27-4e22d3083bed tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:43:53.460465 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5e1508d4-1866-4719-af27-4e22d3083bed tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:43:53.460897 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5e1508d4-1866-4719-af27-4e22d3083bed tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:43:53.592072 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-5e1508d4-1866-4719-af27-4e22d3083bed tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d005ca3fb6a40d2850c9d34a5ab7096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f0cd3e66ff4f08bcabdd66f24995ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:43:53.599805 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-5e1508d4-1866-4719-af27-4e22d3083bed tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] 10.222.0.33 "GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347" status: 200 len: 1576 microversion: 2.1 time: 0.152199 Jul 28 05:43:53.600372 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 831/1055] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:43:53 2022] GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:43:54.621917 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-f242c23e-6a44-4fe8-ad9f-e5eb1a60edfc tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:43:54.622557 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-f242c23e-6a44-4fe8-ad9f-e5eb1a60edfc tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] [instance: 37d4fabd-fff3-4a2e-8278-a2451c230347] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:43:54.629073 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f242c23e-6a44-4fe8-ad9f-e5eb1a60edfc tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:43:54.629540 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f242c23e-6a44-4fe8-ad9f-e5eb1a60edfc tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:43:54.630292 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f242c23e-6a44-4fe8-ad9f-e5eb1a60edfc tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:43:54.630721 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f242c23e-6a44-4fe8-ad9f-e5eb1a60edfc tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:43:54.762635 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-f242c23e-6a44-4fe8-ad9f-e5eb1a60edfc tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d005ca3fb6a40d2850c9d34a5ab7096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f0cd3e66ff4f08bcabdd66f24995ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:43:54.770601 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-f242c23e-6a44-4fe8-ad9f-e5eb1a60edfc tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] 10.222.0.33 "GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347" status: 200 len: 1576 microversion: 2.1 time: 0.152617 Jul 28 05:43:54.771193 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 832/1056] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:43:54 2022] GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:43:55.792075 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-1393d2d3-0f51-4a27-8680-8f26fac8bc84 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:43:55.792696 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-1393d2d3-0f51-4a27-8680-8f26fac8bc84 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] [instance: 37d4fabd-fff3-4a2e-8278-a2451c230347] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:43:55.799786 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1393d2d3-0f51-4a27-8680-8f26fac8bc84 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:43:55.800228 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1393d2d3-0f51-4a27-8680-8f26fac8bc84 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:43:55.800975 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1393d2d3-0f51-4a27-8680-8f26fac8bc84 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:43:55.801402 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-1393d2d3-0f51-4a27-8680-8f26fac8bc84 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:43:55.933122 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-1393d2d3-0f51-4a27-8680-8f26fac8bc84 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d005ca3fb6a40d2850c9d34a5ab7096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f0cd3e66ff4f08bcabdd66f24995ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:43:55.941338 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-1393d2d3-0f51-4a27-8680-8f26fac8bc84 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] 10.222.0.33 "GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347" status: 200 len: 1576 microversion: 2.1 time: 0.153050 Jul 28 05:43:55.941937 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 833/1057] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:43:55 2022] GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:43:56.963154 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-ef25ccfd-f8e2-47e7-9d2f-313c64a4d718 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:43:56.963865 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-ef25ccfd-f8e2-47e7-9d2f-313c64a4d718 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] [instance: 37d4fabd-fff3-4a2e-8278-a2451c230347] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:43:56.970822 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ef25ccfd-f8e2-47e7-9d2f-313c64a4d718 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:43:56.971274 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ef25ccfd-f8e2-47e7-9d2f-313c64a4d718 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:43:56.972041 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ef25ccfd-f8e2-47e7-9d2f-313c64a4d718 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:43:56.972476 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ef25ccfd-f8e2-47e7-9d2f-313c64a4d718 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:43:57.102542 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-ef25ccfd-f8e2-47e7-9d2f-313c64a4d718 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d005ca3fb6a40d2850c9d34a5ab7096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f0cd3e66ff4f08bcabdd66f24995ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:43:57.110896 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-ef25ccfd-f8e2-47e7-9d2f-313c64a4d718 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] 10.222.0.33 "GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347" status: 200 len: 1576 microversion: 2.1 time: 0.151934 Jul 28 05:43:57.117448 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 834/1058] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:43:56 2022] GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:43:57.514442 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-d067e4f9-8603-421d-bbb5-ae87f895c550 req-e575fd25-6968-4be2-b985-136d2f4b8d74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37d4fabd-fff3-4a2e-8278-a2451c230347", "name": "network-vif-plugged", "status": "completed", "tag": "dabecf43-c874-4b75-a78a-c55fa1c40977"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:43:57.523749 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-d067e4f9-8603-421d-bbb5-ae87f895c550 req-e575fd25-6968-4be2-b985-136d2f4b8d74 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:43:57.524197 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-d067e4f9-8603-421d-bbb5-ae87f895c550 req-e575fd25-6968-4be2-b985-136d2f4b8d74 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:43:57.534694 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-d067e4f9-8603-421d-bbb5-ae87f895c550 req-e575fd25-6968-4be2-b985-136d2f4b8d74 service nova] Creating event network-vif-plugged:dabecf43-c874-4b75-a78a-c55fa1c40977 for instance 37d4fabd-fff3-4a2e-8278-a2451c230347 on hv-cinder-79987 Jul 28 05:43:57.539677 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-d067e4f9-8603-421d-bbb5-ae87f895c550 req-e575fd25-6968-4be2-b985-136d2f4b8d74 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029192 Jul 28 05:43:57.540271 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 835/1059] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:43:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 05:43:58.133201 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-f52d2678-b5f6-4f1e-9f46-835a490d187e tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:43:58.133863 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-f52d2678-b5f6-4f1e-9f46-835a490d187e tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] [instance: 37d4fabd-fff3-4a2e-8278-a2451c230347] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:43:58.140859 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f52d2678-b5f6-4f1e-9f46-835a490d187e tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:43:58.141300 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f52d2678-b5f6-4f1e-9f46-835a490d187e tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:43:58.142102 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f52d2678-b5f6-4f1e-9f46-835a490d187e tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:43:58.142541 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f52d2678-b5f6-4f1e-9f46-835a490d187e tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:43:58.273752 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-f52d2678-b5f6-4f1e-9f46-835a490d187e tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d005ca3fb6a40d2850c9d34a5ab7096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f0cd3e66ff4f08bcabdd66f24995ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:43:58.282063 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-f52d2678-b5f6-4f1e-9f46-835a490d187e tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] 10.222.0.33 "GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347" status: 200 len: 1576 microversion: 2.1 time: 0.153669 Jul 28 05:43:58.282632 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 836/1060] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:43:58 2022] GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:43:59.305038 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-8af5f9d3-6d13-45ed-8487-7c6643b560f5 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:43:59.305703 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-8af5f9d3-6d13-45ed-8487-7c6643b560f5 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] [instance: 37d4fabd-fff3-4a2e-8278-a2451c230347] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:43:59.308234 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:43:59.313616 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8af5f9d3-6d13-45ed-8487-7c6643b560f5 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:43:59.314063 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8af5f9d3-6d13-45ed-8487-7c6643b560f5 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:43:59.314812 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8af5f9d3-6d13-45ed-8487-7c6643b560f5 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:43:59.315243 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-8af5f9d3-6d13-45ed-8487-7c6643b560f5 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:43:59.333450 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:43:59.448060 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-8af5f9d3-6d13-45ed-8487-7c6643b560f5 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d005ca3fb6a40d2850c9d34a5ab7096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f0cd3e66ff4f08bcabdd66f24995ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:43:59.456227 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-8af5f9d3-6d13-45ed-8487-7c6643b560f5 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] 10.222.0.33 "GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347" status: 200 len: 1563 microversion: 2.1 time: 0.155076 Jul 28 05:43:59.456798 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 837/1061] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:43:59 2022] GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347 => generated 1563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:44:40.484389 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-2579d816-d133-4bbc-b3b6-b668755be47b tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-389882995", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-394088638", "security_groups": [{"name": "tempest-secgroup-smoke-88218149"}], "block_device_mapping_v2": [{"uuid": "20d44352-fe31-4acb-b819-2df97091f3c1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5edb77fb-18f0-41c1-85ec-83f10d2e2f1e"}]}} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:44:40.494624 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_api:SELECT=1 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:44:40.495204 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell1:SELECT=2 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:44:40.596724 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.network.neutron [None req-2579d816-d133-4bbc-b3b6-b668755be47b tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] validate_networks() for [('5edb77fb-18f0-41c1-85ec-83f10d2e2f1e', None, None, None, None, None)] {{(pid=124482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 05:44:40.980864 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-2579d816-d133-4bbc-b3b6-b668755be47b tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Flavor limits 0:0:0 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 05:44:40.981284 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-2579d816-d133-4bbc-b3b6-b668755be47b tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Image limits 0:0:0 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 05:44:40.981789 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-2579d816-d133-4bbc-b3b6-b668755be47b tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Flavor pref 0:0:0 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 05:44:40.982196 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-2579d816-d133-4bbc-b3b6-b668755be47b tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Image pref 0:0:0 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 05:44:40.982602 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.virt.hardware [None req-2579d816-d133-4bbc-b3b6-b668755be47b tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 05:44:40.991393 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2579d816-d133-4bbc-b3b6-b668755be47b tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:44:40.991864 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2579d816-d133-4bbc-b3b6-b668755be47b tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:44:40.992658 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2579d816-d133-4bbc-b3b6-b668755be47b tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:44:40.993087 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-2579d816-d133-4bbc-b3b6-b668755be47b tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:44:41.165192 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.quota [None req-2579d816-d133-4bbc-b3b6-b668755be47b tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Getting quotas for project 049ba77de43b4702832529d687f5f7a3. Resources: {'ram', 'instances', 'cores'} {{(pid=124482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 05:44:41.168964 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.quota [None req-2579d816-d133-4bbc-b3b6-b668755be47b tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Getting quotas for user 09217832f8e74db38d990d25faee4305 and project 049ba77de43b4702832529d687f5f7a3. Resources: {'ram', 'instances', 'cores'} {{(pid=124482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 05:44:41.225399 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-2579d816-d133-4bbc-b3b6-b668755be47b tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Going to run 1 instances... {{(pid=124482) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 05:44:41.227566 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-2579d816-d133-4bbc-b3b6-b668755be47b tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: e943ad39-1dca-4798-9e61-12305b570d2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='20d44352-fe31-4acb-b819-2df97091f3c1',volume_size=None,volume_type=None)] {{(pid=124482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 05:44:41.651695 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-2579d816-d133-4bbc-b3b6-b668755be47b tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.171262 Jul 28 05:44:41.652405 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 838/1062] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Jul 28 05:44:40 2022] POST /compute/v2.1/servers => generated 404 bytes in 1173 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 05:44:41.663962 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-1062cf6f-ee68-4d7b-a817-433808e7858b tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:44:41.664691 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-1062cf6f-ee68-4d7b-a817-433808e7858b tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: e943ad39-1dca-4798-9e61-12305b570d2b] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:44:41.717404 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-1062cf6f-ee68-4d7b-a817-433808e7858b tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09217832f8e74db38d990d25faee4305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049ba77de43b4702832529d687f5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:44:41.724558 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-1062cf6f-ee68-4d7b-a817-433808e7858b tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "GET /compute/v2.1/servers/e943ad39-1dca-4798-9e61-12305b570d2b" status: 200 len: 1093 microversion: 2.1 time: 0.065366 Jul 28 05:44:41.725117 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 839/1063] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:44:41 2022] GET /compute/v2.1/servers/e943ad39-1dca-4798-9e61-12305b570d2b => generated 1093 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:44:42.744511 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-d2bf5194-1be9-418f-ae8c-939feff08367 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:44:42.745249 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-d2bf5194-1be9-418f-ae8c-939feff08367 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: e943ad39-1dca-4798-9e61-12305b570d2b] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:44:42.752457 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d2bf5194-1be9-418f-ae8c-939feff08367 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:44:42.752905 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d2bf5194-1be9-418f-ae8c-939feff08367 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:44:42.753740 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d2bf5194-1be9-418f-ae8c-939feff08367 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:44:42.754806 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d2bf5194-1be9-418f-ae8c-939feff08367 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:44:42.815804 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-d2bf5194-1be9-418f-ae8c-939feff08367 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09217832f8e74db38d990d25faee4305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049ba77de43b4702832529d687f5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:44:42.824368 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-d2bf5194-1be9-418f-ae8c-939feff08367 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "GET /compute/v2.1/servers/e943ad39-1dca-4798-9e61-12305b570d2b" status: 200 len: 1143 microversion: 2.1 time: 0.083656 Jul 28 05:44:42.824942 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 840/1064] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:44:42 2022] GET /compute/v2.1/servers/e943ad39-1dca-4798-9e61-12305b570d2b => generated 1143 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:44:43.849503 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-7f692af6-2a5b-47a9-8888-bbcfc61cc050 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:44:43.849503 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-7f692af6-2a5b-47a9-8888-bbcfc61cc050 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: e943ad39-1dca-4798-9e61-12305b570d2b] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:44:43.852146 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7f692af6-2a5b-47a9-8888-bbcfc61cc050 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:44:43.852579 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7f692af6-2a5b-47a9-8888-bbcfc61cc050 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:44:43.853402 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7f692af6-2a5b-47a9-8888-bbcfc61cc050 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:44:43.853861 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7f692af6-2a5b-47a9-8888-bbcfc61cc050 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:44:43.917854 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-7f692af6-2a5b-47a9-8888-bbcfc61cc050 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09217832f8e74db38d990d25faee4305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049ba77de43b4702832529d687f5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:44:43.925294 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-7f692af6-2a5b-47a9-8888-bbcfc61cc050 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "GET /compute/v2.1/servers/e943ad39-1dca-4798-9e61-12305b570d2b" status: 200 len: 1209 microversion: 2.1 time: 0.084967 Jul 28 05:44:43.926131 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 841/1065] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:44:43 2022] GET /compute/v2.1/servers/e943ad39-1dca-4798-9e61-12305b570d2b => generated 1209 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:44:44.954162 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-ed8c888d-7147-4d94-aea1-49d2e4523f44 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:44:44.954868 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-ed8c888d-7147-4d94-aea1-49d2e4523f44 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: e943ad39-1dca-4798-9e61-12305b570d2b] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:44:44.962290 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ed8c888d-7147-4d94-aea1-49d2e4523f44 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:44:44.963381 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ed8c888d-7147-4d94-aea1-49d2e4523f44 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:44:44.964184 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ed8c888d-7147-4d94-aea1-49d2e4523f44 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:44:44.964625 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ed8c888d-7147-4d94-aea1-49d2e4523f44 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:44:45.368563 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-ed8c888d-7147-4d94-aea1-49d2e4523f44 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09217832f8e74db38d990d25faee4305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049ba77de43b4702832529d687f5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:44:45.376545 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-ed8c888d-7147-4d94-aea1-49d2e4523f44 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "GET /compute/v2.1/servers/e943ad39-1dca-4798-9e61-12305b570d2b" status: 200 len: 1275 microversion: 2.1 time: 0.426186 Jul 28 05:44:45.377223 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 842/1066] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:44:44 2022] GET /compute/v2.1/servers/e943ad39-1dca-4798-9e61-12305b570d2b => generated 1275 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:44:45.560440 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-9b3d1cb6-6345-4ee1-951f-a68e1e00e257 req-0bcf27e6-f7f1-4d44-baa1-ef2e1fd71800 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e943ad39-1dca-4798-9e61-12305b570d2b", "tag": "79376b08-8039-456b-b2ed-69908dde5291"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:44:45.573366 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-9b3d1cb6-6345-4ee1-951f-a68e1e00e257 req-0bcf27e6-f7f1-4d44-baa1-ef2e1fd71800 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:44:45.573982 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-9b3d1cb6-6345-4ee1-951f-a68e1e00e257 req-0bcf27e6-f7f1-4d44-baa1-ef2e1fd71800 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:44:45.587398 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-9b3d1cb6-6345-4ee1-951f-a68e1e00e257 req-0bcf27e6-f7f1-4d44-baa1-ef2e1fd71800 service nova] Creating event network-changed:79376b08-8039-456b-b2ed-69908dde5291 for instance e943ad39-1dca-4798-9e61-12305b570d2b on hv-cinder-79987 Jul 28 05:44:45.593003 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-9b3d1cb6-6345-4ee1-951f-a68e1e00e257 req-0bcf27e6-f7f1-4d44-baa1-ef2e1fd71800 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036767 Jul 28 05:44:45.593695 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 843/1067] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:44:46.399929 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-6126a87f-f3c9-415d-84aa-adf82976649c tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:44:46.400635 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-6126a87f-f3c9-415d-84aa-adf82976649c tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: e943ad39-1dca-4798-9e61-12305b570d2b] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:44:46.407280 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-6126a87f-f3c9-415d-84aa-adf82976649c tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:44:46.407725 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-6126a87f-f3c9-415d-84aa-adf82976649c tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:44:46.408510 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-6126a87f-f3c9-415d-84aa-adf82976649c tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:44:46.408929 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-6126a87f-f3c9-415d-84aa-adf82976649c tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:44:46.541071 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-6126a87f-f3c9-415d-84aa-adf82976649c tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09217832f8e74db38d990d25faee4305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049ba77de43b4702832529d687f5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:44:46.548654 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-6126a87f-f3c9-415d-84aa-adf82976649c tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "GET /compute/v2.1/servers/e943ad39-1dca-4798-9e61-12305b570d2b" status: 200 len: 1263 microversion: 2.1 time: 0.154174 Jul 28 05:44:46.549231 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 844/1068] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:44:46 2022] GET /compute/v2.1/servers/e943ad39-1dca-4798-9e61-12305b570d2b => generated 1263 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:44:47.570292 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-06b2c996-d307-493d-a45a-12f443ab7784 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:44:47.571013 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-06b2c996-d307-493d-a45a-12f443ab7784 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: e943ad39-1dca-4798-9e61-12305b570d2b] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:44:47.577686 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-06b2c996-d307-493d-a45a-12f443ab7784 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:44:47.578134 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-06b2c996-d307-493d-a45a-12f443ab7784 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:44:47.578899 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-06b2c996-d307-493d-a45a-12f443ab7784 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:44:47.579332 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-06b2c996-d307-493d-a45a-12f443ab7784 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:44:47.715903 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-06b2c996-d307-493d-a45a-12f443ab7784 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09217832f8e74db38d990d25faee4305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049ba77de43b4702832529d687f5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:44:47.723507 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-06b2c996-d307-493d-a45a-12f443ab7784 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "GET /compute/v2.1/servers/e943ad39-1dca-4798-9e61-12305b570d2b" status: 200 len: 1263 microversion: 2.1 time: 0.157192 Jul 28 05:44:47.724073 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 845/1069] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:44:47 2022] GET /compute/v2.1/servers/e943ad39-1dca-4798-9e61-12305b570d2b => generated 1263 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:44:48.744392 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-7f633664-d88d-4c64-8a61-5af5b9fa5bbc tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:44:48.745027 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-7f633664-d88d-4c64-8a61-5af5b9fa5bbc tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: e943ad39-1dca-4798-9e61-12305b570d2b] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:44:48.751294 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7f633664-d88d-4c64-8a61-5af5b9fa5bbc tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:44:48.751736 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7f633664-d88d-4c64-8a61-5af5b9fa5bbc tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:44:48.752481 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7f633664-d88d-4c64-8a61-5af5b9fa5bbc tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:44:48.752908 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7f633664-d88d-4c64-8a61-5af5b9fa5bbc tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:44:48.879965 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-7f633664-d88d-4c64-8a61-5af5b9fa5bbc tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09217832f8e74db38d990d25faee4305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049ba77de43b4702832529d687f5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:44:48.887310 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-7f633664-d88d-4c64-8a61-5af5b9fa5bbc tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "GET /compute/v2.1/servers/e943ad39-1dca-4798-9e61-12305b570d2b" status: 200 len: 1263 microversion: 2.1 time: 0.146841 Jul 28 05:44:48.895113 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 846/1070] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:44:48 2022] GET /compute/v2.1/servers/e943ad39-1dca-4798-9e61-12305b570d2b => generated 1263 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:44:49.908140 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-0cd18579-30e9-48de-bcca-d9379de346be tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:44:49.908802 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-0cd18579-30e9-48de-bcca-d9379de346be tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: e943ad39-1dca-4798-9e61-12305b570d2b] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:44:49.916058 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-0cd18579-30e9-48de-bcca-d9379de346be tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:44:49.916508 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-0cd18579-30e9-48de-bcca-d9379de346be tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:44:49.917264 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-0cd18579-30e9-48de-bcca-d9379de346be tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:44:49.917731 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-0cd18579-30e9-48de-bcca-d9379de346be tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:44:50.046481 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-0cd18579-30e9-48de-bcca-d9379de346be tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09217832f8e74db38d990d25faee4305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049ba77de43b4702832529d687f5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:44:50.054623 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-0cd18579-30e9-48de-bcca-d9379de346be tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "GET /compute/v2.1/servers/e943ad39-1dca-4798-9e61-12305b570d2b" status: 200 len: 1263 microversion: 2.1 time: 0.150363 Jul 28 05:44:50.055202 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 847/1071] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:44:49 2022] GET /compute/v2.1/servers/e943ad39-1dca-4798-9e61-12305b570d2b => generated 1263 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:44:51.075232 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-d498b84d-59d5-44c8-8554-3cc9950b2dfd tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:44:51.075933 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-d498b84d-59d5-44c8-8554-3cc9950b2dfd tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: e943ad39-1dca-4798-9e61-12305b570d2b] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:44:51.082896 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d498b84d-59d5-44c8-8554-3cc9950b2dfd tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:44:51.083348 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d498b84d-59d5-44c8-8554-3cc9950b2dfd tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:44:51.084107 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d498b84d-59d5-44c8-8554-3cc9950b2dfd tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:44:51.084544 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d498b84d-59d5-44c8-8554-3cc9950b2dfd tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:44:51.156362 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell0:SELECT=2 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:44:51.212670 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-d498b84d-59d5-44c8-8554-3cc9950b2dfd tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09217832f8e74db38d990d25faee4305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049ba77de43b4702832529d687f5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:44:51.219986 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-d498b84d-59d5-44c8-8554-3cc9950b2dfd tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "GET /compute/v2.1/servers/e943ad39-1dca-4798-9e61-12305b570d2b" status: 200 len: 1263 microversion: 2.1 time: 0.148620 Jul 28 05:44:51.224431 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 848/1072] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:44:51 2022] GET /compute/v2.1/servers/e943ad39-1dca-4798-9e61-12305b570d2b => generated 1263 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:44:52.242104 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-60a98ae2-d6dc-4a75-8812-2185ce3f056b tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:44:52.242714 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-60a98ae2-d6dc-4a75-8812-2185ce3f056b tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: e943ad39-1dca-4798-9e61-12305b570d2b] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:44:52.244534 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell0:SELECT=8 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:44:52.249851 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-60a98ae2-d6dc-4a75-8812-2185ce3f056b tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:44:52.250296 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-60a98ae2-d6dc-4a75-8812-2185ce3f056b tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:44:52.251055 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-60a98ae2-d6dc-4a75-8812-2185ce3f056b tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:44:52.251495 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-60a98ae2-d6dc-4a75-8812-2185ce3f056b tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:44:52.385748 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-60a98ae2-d6dc-4a75-8812-2185ce3f056b tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09217832f8e74db38d990d25faee4305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049ba77de43b4702832529d687f5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:44:52.393619 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-60a98ae2-d6dc-4a75-8812-2185ce3f056b tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "GET /compute/v2.1/servers/e943ad39-1dca-4798-9e61-12305b570d2b" status: 200 len: 1263 microversion: 2.1 time: 0.155964 Jul 28 05:44:52.394199 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 849/1073] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:44:52 2022] GET /compute/v2.1/servers/e943ad39-1dca-4798-9e61-12305b570d2b => generated 1263 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:44:53.414717 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-f0e752ed-a5bf-48cf-b67b-68fa8ae605c0 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:44:53.415356 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-f0e752ed-a5bf-48cf-b67b-68fa8ae605c0 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: e943ad39-1dca-4798-9e61-12305b570d2b] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:44:53.421791 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f0e752ed-a5bf-48cf-b67b-68fa8ae605c0 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:44:53.422240 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f0e752ed-a5bf-48cf-b67b-68fa8ae605c0 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:44:53.422991 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f0e752ed-a5bf-48cf-b67b-68fa8ae605c0 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:44:53.423657 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f0e752ed-a5bf-48cf-b67b-68fa8ae605c0 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:44:53.554348 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-f0e752ed-a5bf-48cf-b67b-68fa8ae605c0 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09217832f8e74db38d990d25faee4305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049ba77de43b4702832529d687f5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:44:53.561791 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-f0e752ed-a5bf-48cf-b67b-68fa8ae605c0 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "GET /compute/v2.1/servers/e943ad39-1dca-4798-9e61-12305b570d2b" status: 200 len: 1263 microversion: 2.1 time: 0.150974 Jul 28 05:44:53.562360 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 850/1074] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:44:53 2022] GET /compute/v2.1/servers/e943ad39-1dca-4798-9e61-12305b570d2b => generated 1263 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:44:54.583281 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-d9486ae8-80e8-462f-a206-782c6e3651cf tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:44:54.583906 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-d9486ae8-80e8-462f-a206-782c6e3651cf tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: e943ad39-1dca-4798-9e61-12305b570d2b] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:44:54.590367 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d9486ae8-80e8-462f-a206-782c6e3651cf tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:44:54.590818 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d9486ae8-80e8-462f-a206-782c6e3651cf tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:44:54.591581 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d9486ae8-80e8-462f-a206-782c6e3651cf tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:44:54.592019 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-d9486ae8-80e8-462f-a206-782c6e3651cf tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:44:54.723390 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-d9486ae8-80e8-462f-a206-782c6e3651cf tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09217832f8e74db38d990d25faee4305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049ba77de43b4702832529d687f5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:44:54.730840 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-d9486ae8-80e8-462f-a206-782c6e3651cf tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "GET /compute/v2.1/servers/e943ad39-1dca-4798-9e61-12305b570d2b" status: 200 len: 1263 microversion: 2.1 time: 0.152158 Jul 28 05:44:54.731407 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 851/1075] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:44:54 2022] GET /compute/v2.1/servers/e943ad39-1dca-4798-9e61-12305b570d2b => generated 1263 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:44:55.751621 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-0cffafdc-b4c2-4049-98ad-726d4c5eb03c tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:44:55.752284 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-0cffafdc-b4c2-4049-98ad-726d4c5eb03c tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: e943ad39-1dca-4798-9e61-12305b570d2b] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:44:55.758681 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-0cffafdc-b4c2-4049-98ad-726d4c5eb03c tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:44:55.759135 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-0cffafdc-b4c2-4049-98ad-726d4c5eb03c tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:44:55.759893 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-0cffafdc-b4c2-4049-98ad-726d4c5eb03c tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:44:55.760326 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-0cffafdc-b4c2-4049-98ad-726d4c5eb03c tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:44:55.895328 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-0cffafdc-b4c2-4049-98ad-726d4c5eb03c tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09217832f8e74db38d990d25faee4305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049ba77de43b4702832529d687f5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:44:55.903052 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-0cffafdc-b4c2-4049-98ad-726d4c5eb03c tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "GET /compute/v2.1/servers/e943ad39-1dca-4798-9e61-12305b570d2b" status: 200 len: 1263 microversion: 2.1 time: 0.155300 Jul 28 05:44:55.903860 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 852/1076] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:44:55 2022] GET /compute/v2.1/servers/e943ad39-1dca-4798-9e61-12305b570d2b => generated 1263 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:44:56.924312 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-bded4ed3-384f-478d-b7c7-2076488e9174 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:44:56.925010 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-bded4ed3-384f-478d-b7c7-2076488e9174 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: e943ad39-1dca-4798-9e61-12305b570d2b] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:44:56.932072 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-bded4ed3-384f-478d-b7c7-2076488e9174 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:44:56.932531 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-bded4ed3-384f-478d-b7c7-2076488e9174 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:44:56.933277 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-bded4ed3-384f-478d-b7c7-2076488e9174 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:44:56.933742 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-bded4ed3-384f-478d-b7c7-2076488e9174 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:44:57.065957 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-bded4ed3-384f-478d-b7c7-2076488e9174 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09217832f8e74db38d990d25faee4305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049ba77de43b4702832529d687f5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:44:57.073508 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-bded4ed3-384f-478d-b7c7-2076488e9174 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "GET /compute/v2.1/servers/e943ad39-1dca-4798-9e61-12305b570d2b" status: 200 len: 1263 microversion: 2.1 time: 0.153069 Jul 28 05:44:57.074078 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 853/1077] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:44:56 2022] GET /compute/v2.1/servers/e943ad39-1dca-4798-9e61-12305b570d2b => generated 1263 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:44:57.880358 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-264491ae-6d40-4797-90c1-8a488b209017 req-9094b37b-7d63-4eac-8cdf-8aa6b47ccea7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e943ad39-1dca-4798-9e61-12305b570d2b", "name": "network-vif-plugged", "status": "completed", "tag": "79376b08-8039-456b-b2ed-69908dde5291"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:44:57.890265 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-264491ae-6d40-4797-90c1-8a488b209017 req-9094b37b-7d63-4eac-8cdf-8aa6b47ccea7 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:44:57.890713 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-264491ae-6d40-4797-90c1-8a488b209017 req-9094b37b-7d63-4eac-8cdf-8aa6b47ccea7 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:44:57.901803 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-264491ae-6d40-4797-90c1-8a488b209017 req-9094b37b-7d63-4eac-8cdf-8aa6b47ccea7 service nova] Creating event network-vif-plugged:79376b08-8039-456b-b2ed-69908dde5291 for instance e943ad39-1dca-4798-9e61-12305b570d2b on hv-cinder-79987 Jul 28 05:44:57.906886 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-264491ae-6d40-4797-90c1-8a488b209017 req-9094b37b-7d63-4eac-8cdf-8aa6b47ccea7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030920 Jul 28 05:44:57.907468 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 854/1078] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:44:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 05:44:58.095449 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-4c2b5d90-a6d9-4a5a-a5bc-3e0016586ebf tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:44:58.096210 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-4c2b5d90-a6d9-4a5a-a5bc-3e0016586ebf tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: e943ad39-1dca-4798-9e61-12305b570d2b] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:44:58.102949 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4c2b5d90-a6d9-4a5a-a5bc-3e0016586ebf tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:44:58.103539 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4c2b5d90-a6d9-4a5a-a5bc-3e0016586ebf tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:44:58.104313 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4c2b5d90-a6d9-4a5a-a5bc-3e0016586ebf tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:44:58.104784 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-4c2b5d90-a6d9-4a5a-a5bc-3e0016586ebf tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:44:58.242607 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-4c2b5d90-a6d9-4a5a-a5bc-3e0016586ebf tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09217832f8e74db38d990d25faee4305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049ba77de43b4702832529d687f5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:44:58.250095 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-4c2b5d90-a6d9-4a5a-a5bc-3e0016586ebf tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "GET /compute/v2.1/servers/e943ad39-1dca-4798-9e61-12305b570d2b" status: 200 len: 1263 microversion: 2.1 time: 0.159449 Jul 28 05:44:58.250660 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 855/1079] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:44:58 2022] GET /compute/v2.1/servers/e943ad39-1dca-4798-9e61-12305b570d2b => generated 1263 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:44:59.271773 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-c92641b4-11aa-4cfe-af23-3f2c6055477b tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:44:59.272398 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-c92641b4-11aa-4cfe-af23-3f2c6055477b tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: e943ad39-1dca-4798-9e61-12305b570d2b] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:44:59.278862 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c92641b4-11aa-4cfe-af23-3f2c6055477b tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:44:59.279900 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c92641b4-11aa-4cfe-af23-3f2c6055477b tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:44:59.280904 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c92641b4-11aa-4cfe-af23-3f2c6055477b tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:44:59.281277 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c92641b4-11aa-4cfe-af23-3f2c6055477b tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:44:59.423187 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-c92641b4-11aa-4cfe-af23-3f2c6055477b tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09217832f8e74db38d990d25faee4305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049ba77de43b4702832529d687f5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:44:59.431114 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-c92641b4-11aa-4cfe-af23-3f2c6055477b tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "GET /compute/v2.1/servers/e943ad39-1dca-4798-9e61-12305b570d2b" status: 200 len: 1263 microversion: 2.1 time: 0.163925 Jul 28 05:44:59.431678 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 856/1080] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:44:59 2022] GET /compute/v2.1/servers/e943ad39-1dca-4798-9e61-12305b570d2b => generated 1263 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:45:00.458527 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-b4eefff1-b7ea-4a00-af21-07f93cd2db0e tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:45:00.459138 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-b4eefff1-b7ea-4a00-af21-07f93cd2db0e tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: e943ad39-1dca-4798-9e61-12305b570d2b] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:45:00.465629 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b4eefff1-b7ea-4a00-af21-07f93cd2db0e tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:45:00.466083 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b4eefff1-b7ea-4a00-af21-07f93cd2db0e tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:45:00.466852 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b4eefff1-b7ea-4a00-af21-07f93cd2db0e tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:45:00.467287 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-b4eefff1-b7ea-4a00-af21-07f93cd2db0e tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:45:00.484761 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell1:SELECT=100 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:45:00.597171 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-b4eefff1-b7ea-4a00-af21-07f93cd2db0e tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09217832f8e74db38d990d25faee4305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049ba77de43b4702832529d687f5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:45:00.605191 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-b4eefff1-b7ea-4a00-af21-07f93cd2db0e tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "GET /compute/v2.1/servers/e943ad39-1dca-4798-9e61-12305b570d2b" status: 200 len: 1450 microversion: 2.1 time: 0.151134 Jul 28 05:45:00.605786 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 857/1081] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:45:00 2022] GET /compute/v2.1/servers/e943ad39-1dca-4798-9e61-12305b570d2b => generated 1450 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:45:00.625365 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-9259a04d-399a-4311-b41a-55977669ed75 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:45:00.626017 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-9259a04d-399a-4311-b41a-55977669ed75 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: e943ad39-1dca-4798-9e61-12305b570d2b] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:45:00.631841 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9259a04d-399a-4311-b41a-55977669ed75 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:45:00.632275 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9259a04d-399a-4311-b41a-55977669ed75 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:45:00.633023 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9259a04d-399a-4311-b41a-55977669ed75 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:45:00.633453 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9259a04d-399a-4311-b41a-55977669ed75 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:45:00.768051 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-9259a04d-399a-4311-b41a-55977669ed75 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09217832f8e74db38d990d25faee4305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049ba77de43b4702832529d687f5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:45:00.776009 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-9259a04d-399a-4311-b41a-55977669ed75 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "GET /compute/v2.1/servers/e943ad39-1dca-4798-9e61-12305b570d2b" status: 200 len: 1450 microversion: 2.1 time: 0.154316 Jul 28 05:45:00.776573 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 858/1082] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:45:00 2022] GET /compute/v2.1/servers/e943ad39-1dca-4798-9e61-12305b570d2b => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:45:02.631800 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-887314a2-7cb2-4a56-8c55-c4a0c06aa664 req-17baa64d-9102-4878-b52c-3697794b3928 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e943ad39-1dca-4798-9e61-12305b570d2b", "tag": "79376b08-8039-456b-b2ed-69908dde5291"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:45:02.642017 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-887314a2-7cb2-4a56-8c55-c4a0c06aa664 req-17baa64d-9102-4878-b52c-3697794b3928 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:45:02.642462 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-887314a2-7cb2-4a56-8c55-c4a0c06aa664 req-17baa64d-9102-4878-b52c-3697794b3928 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:45:02.653903 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-887314a2-7cb2-4a56-8c55-c4a0c06aa664 req-17baa64d-9102-4878-b52c-3697794b3928 service nova] Creating event network-changed:79376b08-8039-456b-b2ed-69908dde5291 for instance e943ad39-1dca-4798-9e61-12305b570d2b on hv-cinder-79987 Jul 28 05:45:02.658842 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-887314a2-7cb2-4a56-8c55-c4a0c06aa664 req-17baa64d-9102-4878-b52c-3697794b3928 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031310 Jul 28 05:45:02.659636 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 859/1083] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:45:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 05:45:16.489389 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-08282062-676c-41b7-8ace-96b31dea4b82 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:45:16.490049 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-08282062-676c-41b7-8ace-96b31dea4b82 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] [instance: 37d4fabd-fff3-4a2e-8278-a2451c230347] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:45:16.492892 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:45:16.493649 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell1:SELECT=10 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:45:16.498801 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-08282062-676c-41b7-8ace-96b31dea4b82 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:45:16.499321 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-08282062-676c-41b7-8ace-96b31dea4b82 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:45:16.500165 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-08282062-676c-41b7-8ace-96b31dea4b82 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:45:16.500663 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-08282062-676c-41b7-8ace-96b31dea4b82 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:45:16.526286 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-08282062-676c-41b7-8ace-96b31dea4b82 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] [instance: 37d4fabd-fff3-4a2e-8278-a2451c230347] Going to try to terminate instance {{(pid=124482) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 05:45:16.848527 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-08282062-676c-41b7-8ace-96b31dea4b82 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] 10.222.0.33 "DELETE /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347" status: 204 len: 0 microversion: 2.1 time: 0.363495 Jul 28 05:45:16.850907 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 860/1084] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Jul 28 05:45:16 2022] DELETE /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 05:45:16.854364 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-dd664d68-4812-41c7-910b-46a033985f53 req-77b5e19f-b7a8-4555-bc0f-d425210ecd05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37d4fabd-fff3-4a2e-8278-a2451c230347", "tag": "dabecf43-c874-4b75-a78a-c55fa1c40977"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:45:16.863566 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-dd664d68-4812-41c7-910b-46a033985f53 req-77b5e19f-b7a8-4555-bc0f-d425210ecd05 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:45:16.864012 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-dd664d68-4812-41c7-910b-46a033985f53 req-77b5e19f-b7a8-4555-bc0f-d425210ecd05 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:45:16.875498 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-dd664d68-4812-41c7-910b-46a033985f53 req-77b5e19f-b7a8-4555-bc0f-d425210ecd05 service nova] Creating event network-changed:dabecf43-c874-4b75-a78a-c55fa1c40977 for instance 37d4fabd-fff3-4a2e-8278-a2451c230347 on hv-cinder-79987 Jul 28 05:45:16.880324 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-dd664d68-4812-41c7-910b-46a033985f53 req-77b5e19f-b7a8-4555-bc0f-d425210ecd05 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029912 Jul 28 05:45:16.881186 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 861/1085] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:45:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:45:16.886791 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-3da283cd-6c8d-451d-85b2-558048bf245e tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:45:16.888376 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-3da283cd-6c8d-451d-85b2-558048bf245e tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] [instance: 37d4fabd-fff3-4a2e-8278-a2451c230347] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:45:16.894756 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3da283cd-6c8d-451d-85b2-558048bf245e tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:45:16.898311 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3da283cd-6c8d-451d-85b2-558048bf245e tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:45:16.898311 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3da283cd-6c8d-451d-85b2-558048bf245e tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:45:16.898311 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-3da283cd-6c8d-451d-85b2-558048bf245e tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:45:17.036105 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-3da283cd-6c8d-451d-85b2-558048bf245e tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d005ca3fb6a40d2850c9d34a5ab7096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f0cd3e66ff4f08bcabdd66f24995ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:45:17.044060 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-3da283cd-6c8d-451d-85b2-558048bf245e tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] 10.222.0.33 "GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347" status: 200 len: 1569 microversion: 2.1 time: 0.161461 Jul 28 05:45:17.048184 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 862/1086] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:45:16 2022] GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:45:18.066095 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-97006bab-d332-43be-a32f-e4042411e65d tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:45:18.066716 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-97006bab-d332-43be-a32f-e4042411e65d tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] [instance: 37d4fabd-fff3-4a2e-8278-a2451c230347] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:45:18.073655 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-97006bab-d332-43be-a32f-e4042411e65d tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:45:18.080381 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-97006bab-d332-43be-a32f-e4042411e65d tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:45:18.080381 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-97006bab-d332-43be-a32f-e4042411e65d tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:45:18.080381 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-97006bab-d332-43be-a32f-e4042411e65d tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:45:18.207262 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-97006bab-d332-43be-a32f-e4042411e65d tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d005ca3fb6a40d2850c9d34a5ab7096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f0cd3e66ff4f08bcabdd66f24995ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:45:18.214905 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-97006bab-d332-43be-a32f-e4042411e65d tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] 10.222.0.33 "GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347" status: 200 len: 1569 microversion: 2.1 time: 0.152642 Jul 28 05:45:18.215484 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 863/1087] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:45:18 2022] GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:45:18.997649 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-8933bd45-0c28-41ff-98e7-de6f44c7d0db req-e3e30b20-e5d4-4a56-9fa1-5c9f538c9f5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37d4fabd-fff3-4a2e-8278-a2451c230347", "name": "network-vif-deleted", "tag": "dabecf43-c874-4b75-a78a-c55fa1c40977"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:45:19.007008 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-8933bd45-0c28-41ff-98e7-de6f44c7d0db req-e3e30b20-e5d4-4a56-9fa1-5c9f538c9f5d service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:45:19.008762 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-8933bd45-0c28-41ff-98e7-de6f44c7d0db req-e3e30b20-e5d4-4a56-9fa1-5c9f538c9f5d service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:45:19.018570 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-8933bd45-0c28-41ff-98e7-de6f44c7d0db req-e3e30b20-e5d4-4a56-9fa1-5c9f538c9f5d service nova] Creating event network-vif-deleted:dabecf43-c874-4b75-a78a-c55fa1c40977 for instance 37d4fabd-fff3-4a2e-8278-a2451c230347 on hv-cinder-79987 Jul 28 05:45:19.024208 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-8933bd45-0c28-41ff-98e7-de6f44c7d0db req-e3e30b20-e5d4-4a56-9fa1-5c9f538c9f5d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030375 Jul 28 05:45:19.024781 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 864/1088] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:45:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 05:45:19.236575 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-80787722-0a53-4ec0-aacb-8fb80f19d0ec tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:45:19.237220 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-80787722-0a53-4ec0-aacb-8fb80f19d0ec tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] [instance: 37d4fabd-fff3-4a2e-8278-a2451c230347] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:45:19.244448 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-80787722-0a53-4ec0-aacb-8fb80f19d0ec tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:45:19.244894 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-80787722-0a53-4ec0-aacb-8fb80f19d0ec tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:45:19.245682 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-80787722-0a53-4ec0-aacb-8fb80f19d0ec tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:45:19.246118 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-80787722-0a53-4ec0-aacb-8fb80f19d0ec tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:45:19.317113 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-80787722-0a53-4ec0-aacb-8fb80f19d0ec tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d005ca3fb6a40d2850c9d34a5ab7096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f0cd3e66ff4f08bcabdd66f24995ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:45:19.324757 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-80787722-0a53-4ec0-aacb-8fb80f19d0ec tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] 10.222.0.33 "GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347" status: 200 len: 1219 microversion: 2.1 time: 0.092350 Jul 28 05:45:19.325563 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 865/1089] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:45:19 2022] GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:45:20.345973 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-5cddd35f-91af-41db-9ab5-5d2e3a3d3a2a tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:45:20.346710 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-5cddd35f-91af-41db-9ab5-5d2e3a3d3a2a tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] [instance: 37d4fabd-fff3-4a2e-8278-a2451c230347] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:45:20.353277 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5cddd35f-91af-41db-9ab5-5d2e3a3d3a2a tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:45:20.353727 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5cddd35f-91af-41db-9ab5-5d2e3a3d3a2a tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:45:20.354493 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5cddd35f-91af-41db-9ab5-5d2e3a3d3a2a tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:45:20.354960 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5cddd35f-91af-41db-9ab5-5d2e3a3d3a2a tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:45:20.386990 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5cddd35f-91af-41db-9ab5-5d2e3a3d3a2a tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:45:20.387983 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-5cddd35f-91af-41db-9ab5-5d2e3a3d3a2a tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:45:20.388438 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.objects.instance [None req-5cddd35f-91af-41db-9ab5-5d2e3a3d3a2a tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lazy-loading 'fault' on Instance uuid 37d4fabd-fff3-4a2e-8278-a2451c230347 {{(pid=124482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 05:45:20.429056 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-5cddd35f-91af-41db-9ab5-5d2e3a3d3a2a tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d005ca3fb6a40d2850c9d34a5ab7096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f0cd3e66ff4f08bcabdd66f24995ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:45:20.437077 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-5cddd35f-91af-41db-9ab5-5d2e3a3d3a2a tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] 10.222.0.33 "GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347" status: 200 len: 1224 microversion: 2.1 time: 0.094972 Jul 28 05:45:20.437672 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 866/1090] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:45:20 2022] GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347 => generated 1224 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:45:21.460711 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-752c72ed-956c-44b3-bf3d-9cda39230585 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:45:21.462130 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-752c72ed-956c-44b3-bf3d-9cda39230585 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] [instance: 37d4fabd-fff3-4a2e-8278-a2451c230347] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:45:21.468532 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-752c72ed-956c-44b3-bf3d-9cda39230585 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:45:21.468975 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-752c72ed-956c-44b3-bf3d-9cda39230585 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:45:21.469755 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-752c72ed-956c-44b3-bf3d-9cda39230585 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:45:21.470189 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-752c72ed-956c-44b3-bf3d-9cda39230585 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:45:21.483058 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.wsgi [None req-752c72ed-956c-44b3-bf3d-9cda39230585 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] HTTP exception thrown: Instance 37d4fabd-fff3-4a2e-8278-a2451c230347 could not be found. Jul 28 05:45:21.489014 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-752c72ed-956c-44b3-bf3d-9cda39230585 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Request method failure captured: Jul 28 05:45:21.489014 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: request: GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347 HTTP/1.1 Jul 28 05:45:21.489014 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept: application/json Jul 28 05:45:21.489014 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept-Encoding: identity Jul 28 05:45:21.489014 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Connection: close Jul 28 05:45:21.489014 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Length: 0 Jul 28 05:45:21.489014 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Type: application/json Jul 28 05:45:21.489014 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Host: 10.222.0.33 Jul 28 05:45:21.489014 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Openstack-System-Scope: None Jul 28 05:45:21.489014 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: User-Agent: python-urllib3/1.26.10 Jul 28 05:45:21.489014 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Auth-Token: gAAAAABi4iFd0c3saZbIZqCsTiYhBYt9YIh7VlZ51ch4wT6Q8EcJ0W8j-1bH-8CTIsSjyU20mp-tChv0uDeQCmlqIrtdE2FY9KQU5v-Lzz92kH5SHPMPXdAfLMJoJ_4WzNXfAnewPMnfKyqYAiiMPrwGuJ2A3ccNFkrx4jufChwyte4wwKNPnnc Jul 28 05:45:21.489014 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Id: None Jul 28 05:45:21.489014 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Name: None Jul 28 05:45:21.489014 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Identity-Status: Confirmed Jul 28 05:45:21.489014 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Is-Admin-Project: True Jul 28 05:45:21.489014 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Id: default Jul 28 05:45:21.489014 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Name: Default Jul 28 05:45:21.489014 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Id: 42f0cd3e66ff4f08bcabdd66f24995ff Jul 28 05:45:21.489014 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Name: tempest-TestShelveInstance-945507229 Jul 28 05:45:21.489014 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Role: member,reader Jul 28 05:45:21.489014 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Roles: member,reader Jul 28 05:45:21.490695 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/42f0cd3e66ff4f08bcabdd66f24995ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/42f0cd3e66ff4f08bcabdd66f24995ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_42f0cd3e66ff4f08bcabdd66f24995ff", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/42f0cd3e66ff4f08bcabdd66f24995ff"}]}] Jul 28 05:45:21.490695 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant: tempest-TestShelveInstance-945507229 Jul 28 05:45:21.490695 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Id: 42f0cd3e66ff4f08bcabdd66f24995ff Jul 28 05:45:21.490695 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Name: tempest-TestShelveInstance-945507229 Jul 28 05:45:21.490695 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User: tempest-TestShelveInstance-945507229-project Jul 28 05:45:21.490695 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Id: default Jul 28 05:45:21.490695 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Name: Default Jul 28 05:45:21.490695 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Id: 2d005ca3fb6a40d2850c9d34a5ab7096 Jul 28 05:45:21.490695 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Name: tempest-TestShelveInstance-945507229-project Jul 28 05:45:21.490695 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: method: > Jul 28 05:45:21.490695 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: exception: Instance 37d4fabd-fff3-4a2e-8278-a2451c230347 could not be found. Jul 28 05:45:21.490695 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: action_args: {'id': '37d4fabd-fff3-4a2e-8278-a2451c230347'} Jul 28 05:45:21.492290 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 05:45:21.492290 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:45:21.492290 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 05:45:21.492290 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 05:45:21.492290 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 05:45:21.492290 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 05:45:21.492290 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 05:45:21.492290 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 05:45:21.492290 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 05:45:21.492290 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 05:45:21.492290 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37d4fabd-fff3-4a2e-8278-a2451c230347 could not be found. Jul 28 05:45:21.492290 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:45:21.492290 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:45:21.492290 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:45:21.492290 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:45:21.492290 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:45:21.492290 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:45:21.492290 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 05:45:21.492290 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 05:45:21.492290 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 05:45:21.493985 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:45:21.493985 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 05:45:21.493985 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 05:45:21.493985 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 05:45:21.493985 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 05:45:21.493985 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 05:45:21.493985 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 05:45:21.493985 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37d4fabd-fff3-4a2e-8278-a2451c230347 could not be found. Jul 28 05:45:21.493985 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:45:21.493985 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:45:21.493985 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:45:21.493985 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:45:21.493985 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:45:21.493985 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:45:21.493985 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 05:45:21.493985 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 05:45:21.493985 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37d4fabd-fff3-4a2e-8278-a2451c230347 could not be found. Jul 28 05:45:21.493985 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:45:21.495401 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-752c72ed-956c-44b3-bf3d-9cda39230585 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Returning 404 to user: Instance 37d4fabd-fff3-4a2e-8278-a2451c230347 could not be found. {{(pid=124482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 05:45:21.495401 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-752c72ed-956c-44b3-bf3d-9cda39230585 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] 10.222.0.33 "GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347" status: 404 len: 111 microversion: 2.1 time: 0.029277 Jul 28 05:45:21.495401 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 867/1091] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:45:21 2022] GET /compute/v2.1/servers/37d4fabd-fff3-4a2e-8278-a2451c230347 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 05:45:21.705437 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-5f419463-78a1-4e75-b7a4-057c2bea3392 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] Calling method '.version_select at 0x7f25e4b2daf0>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:45:21.786515 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-5f419463-78a1-4e75-b7a4-057c2bea3392 tempest-TestShelveInstance-945507229 tempest-TestShelveInstance-945507229-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1516733317" status: 202 len: 0 microversion: 2.1 time: 0.084853 Jul 28 05:45:21.787124 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 868/1092] 10.222.0.33 () {58 vars in 1254 bytes} [Thu Jul 28 05:45:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1516733317 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 05:46:42.448317 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:46:42.449119 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG dbcounter [-] [124482] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:46:42.453525 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-7355eb07-e788-49cd-b420-2f974c1686a1 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:46:42.454021 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-7355eb07-e788-49cd-b420-2f974c1686a1 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: e943ad39-1dca-4798-9e61-12305b570d2b] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:46:42.460876 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7355eb07-e788-49cd-b420-2f974c1686a1 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:46:42.468827 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7355eb07-e788-49cd-b420-2f974c1686a1 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:46:42.468827 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7355eb07-e788-49cd-b420-2f974c1686a1 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:46:42.468827 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-7355eb07-e788-49cd-b420-2f974c1686a1 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:46:42.488297 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-7355eb07-e788-49cd-b420-2f974c1686a1 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: e943ad39-1dca-4798-9e61-12305b570d2b] Going to try to terminate instance {{(pid=124482) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 05:46:42.709962 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-7355eb07-e788-49cd-b420-2f974c1686a1 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e943ad39-1dca-4798-9e61-12305b570d2b" status: 204 len: 0 microversion: 2.1 time: 0.263482 Jul 28 05:46:42.713761 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 869/1093] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Jul 28 05:46:42 2022] DELETE /compute/v2.1/servers/e943ad39-1dca-4798-9e61-12305b570d2b => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 05:46:42.719975 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-fd7f85fe-0cd1-44db-a756-0739649479d2 req-da133fac-140c-4668-8597-0b1f2182ee49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e943ad39-1dca-4798-9e61-12305b570d2b", "tag": "79376b08-8039-456b-b2ed-69908dde5291"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:46:42.729593 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-fd7f85fe-0cd1-44db-a756-0739649479d2 req-da133fac-140c-4668-8597-0b1f2182ee49 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:46:42.730075 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-fd7f85fe-0cd1-44db-a756-0739649479d2 req-da133fac-140c-4668-8597-0b1f2182ee49 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:46:42.741583 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-fd7f85fe-0cd1-44db-a756-0739649479d2 req-da133fac-140c-4668-8597-0b1f2182ee49 service nova] Creating event network-changed:79376b08-8039-456b-b2ed-69908dde5291 for instance e943ad39-1dca-4798-9e61-12305b570d2b on hv-cinder-79987 Jul 28 05:46:42.746319 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-fd7f85fe-0cd1-44db-a756-0739649479d2 req-da133fac-140c-4668-8597-0b1f2182ee49 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031156 Jul 28 05:46:42.746903 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 870/1094] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:46:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:46:42.752641 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-373702ed-d5cc-40d9-af18-6c7a889410e9 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:46:42.753342 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-373702ed-d5cc-40d9-af18-6c7a889410e9 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: e943ad39-1dca-4798-9e61-12305b570d2b] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:46:42.759709 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-373702ed-d5cc-40d9-af18-6c7a889410e9 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:46:42.760156 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-373702ed-d5cc-40d9-af18-6c7a889410e9 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:46:42.761169 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-373702ed-d5cc-40d9-af18-6c7a889410e9 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:46:42.761752 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-373702ed-d5cc-40d9-af18-6c7a889410e9 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:46:43.108399 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-373702ed-d5cc-40d9-af18-6c7a889410e9 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09217832f8e74db38d990d25faee4305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049ba77de43b4702832529d687f5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:46:43.116330 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-373702ed-d5cc-40d9-af18-6c7a889410e9 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "GET /compute/v2.1/servers/e943ad39-1dca-4798-9e61-12305b570d2b" status: 200 len: 1575 microversion: 2.1 time: 0.368144 Jul 28 05:46:43.117067 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 871/1095] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:46:42 2022] GET /compute/v2.1/servers/e943ad39-1dca-4798-9e61-12305b570d2b => generated 1575 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:46:44.138330 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-9bb13b36-1fa8-4e8b-83d9-213083e08688 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:46:44.138981 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-9bb13b36-1fa8-4e8b-83d9-213083e08688 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: e943ad39-1dca-4798-9e61-12305b570d2b] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:46:44.149328 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9bb13b36-1fa8-4e8b-83d9-213083e08688 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:46:44.149793 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9bb13b36-1fa8-4e8b-83d9-213083e08688 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:46:44.150542 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9bb13b36-1fa8-4e8b-83d9-213083e08688 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:46:44.150974 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9bb13b36-1fa8-4e8b-83d9-213083e08688 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:46:44.289055 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-9bb13b36-1fa8-4e8b-83d9-213083e08688 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09217832f8e74db38d990d25faee4305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049ba77de43b4702832529d687f5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:46:44.297454 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-9bb13b36-1fa8-4e8b-83d9-213083e08688 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "GET /compute/v2.1/servers/e943ad39-1dca-4798-9e61-12305b570d2b" status: 200 len: 1575 microversion: 2.1 time: 0.163294 Jul 28 05:46:44.298277 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 872/1096] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:46:44 2022] GET /compute/v2.1/servers/e943ad39-1dca-4798-9e61-12305b570d2b => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:46:44.884796 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-a162cb14-ce7d-4de8-8a2d-2c09edf9e1d0 req-55f7991d-0a1f-45e5-b926-2cd7abe59c68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e943ad39-1dca-4798-9e61-12305b570d2b", "name": "network-vif-deleted", "tag": "79376b08-8039-456b-b2ed-69908dde5291"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:46:44.894926 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-a162cb14-ce7d-4de8-8a2d-2c09edf9e1d0 req-55f7991d-0a1f-45e5-b926-2cd7abe59c68 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:46:44.895462 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-a162cb14-ce7d-4de8-8a2d-2c09edf9e1d0 req-55f7991d-0a1f-45e5-b926-2cd7abe59c68 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:46:44.908391 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-a162cb14-ce7d-4de8-8a2d-2c09edf9e1d0 req-55f7991d-0a1f-45e5-b926-2cd7abe59c68 service nova] Creating event network-vif-deleted:79376b08-8039-456b-b2ed-69908dde5291 for instance e943ad39-1dca-4798-9e61-12305b570d2b on hv-cinder-79987 Jul 28 05:46:44.913252 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-a162cb14-ce7d-4de8-8a2d-2c09edf9e1d0 req-55f7991d-0a1f-45e5-b926-2cd7abe59c68 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032224 Jul 28 05:46:44.913873 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 873/1097] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:46:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 05:46:45.319811 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-af3d8f3c-ffb9-4019-9437-c4eb76c07686 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:46:45.320502 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-af3d8f3c-ffb9-4019-9437-c4eb76c07686 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: e943ad39-1dca-4798-9e61-12305b570d2b] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:46:45.326601 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-af3d8f3c-ffb9-4019-9437-c4eb76c07686 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:46:45.327042 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-af3d8f3c-ffb9-4019-9437-c4eb76c07686 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:46:45.327819 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-af3d8f3c-ffb9-4019-9437-c4eb76c07686 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:46:45.328404 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-af3d8f3c-ffb9-4019-9437-c4eb76c07686 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:46:45.390325 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-af3d8f3c-ffb9-4019-9437-c4eb76c07686 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09217832f8e74db38d990d25faee4305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049ba77de43b4702832529d687f5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:46:45.398080 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-af3d8f3c-ffb9-4019-9437-c4eb76c07686 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "GET /compute/v2.1/servers/e943ad39-1dca-4798-9e61-12305b570d2b" status: 200 len: 1224 microversion: 2.1 time: 0.082803 Jul 28 05:46:45.398834 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 874/1098] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:46:45 2022] GET /compute/v2.1/servers/e943ad39-1dca-4798-9e61-12305b570d2b => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:46:46.419164 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-054441e6-cc7c-41f6-96b6-dffa333485a9 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:46:46.419824 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-054441e6-cc7c-41f6-96b6-dffa333485a9 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: e943ad39-1dca-4798-9e61-12305b570d2b] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:46:46.426286 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-054441e6-cc7c-41f6-96b6-dffa333485a9 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:46:46.426729 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-054441e6-cc7c-41f6-96b6-dffa333485a9 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:46:46.427549 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-054441e6-cc7c-41f6-96b6-dffa333485a9 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:46:46.427976 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-054441e6-cc7c-41f6-96b6-dffa333485a9 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:46:46.441554 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.wsgi [None req-054441e6-cc7c-41f6-96b6-dffa333485a9 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] HTTP exception thrown: Instance e943ad39-1dca-4798-9e61-12305b570d2b could not be found. Jul 28 05:46:46.443208 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-054441e6-cc7c-41f6-96b6-dffa333485a9 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Request method failure captured: Jul 28 05:46:46.443208 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: request: GET /compute/v2.1/servers/e943ad39-1dca-4798-9e61-12305b570d2b HTTP/1.1 Jul 28 05:46:46.443208 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept: application/json Jul 28 05:46:46.443208 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept-Encoding: identity Jul 28 05:46:46.443208 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Connection: close Jul 28 05:46:46.443208 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Length: 0 Jul 28 05:46:46.443208 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Type: application/json Jul 28 05:46:46.443208 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Host: 10.222.0.33 Jul 28 05:46:46.443208 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Openstack-System-Scope: None Jul 28 05:46:46.443208 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: User-Agent: python-urllib3/1.26.10 Jul 28 05:46:46.443208 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Auth-Token: gAAAAABi4iEUo10EjyAiud_HlyChWASyUX53ZLs3bgD62XMeHj1VqA0lRf7jrNh3T0aAZ5wTRe5tWSLfiJxJdbXzkIEiKWbrjbQ8IpmbYJbAEVE0ubJjmJBSpi2IwOVOQrh4CbPbW6q1MQrZtCWhkLk1sbnuwe5TQw4-WijLZSbY2qEMOhK2mWs Jul 28 05:46:46.443208 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Id: None Jul 28 05:46:46.443208 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Name: None Jul 28 05:46:46.443208 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Identity-Status: Confirmed Jul 28 05:46:46.443208 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Is-Admin-Project: True Jul 28 05:46:46.443208 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Id: default Jul 28 05:46:46.443208 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Name: Default Jul 28 05:46:46.443208 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Id: 049ba77de43b4702832529d687f5f7a3 Jul 28 05:46:46.443208 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Name: tempest-TestVolumeBootPattern-1858841219 Jul 28 05:46:46.443208 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Role: member,reader Jul 28 05:46:46.443208 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Roles: member,reader Jul 28 05:46:46.445053 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/049ba77de43b4702832529d687f5f7a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/049ba77de43b4702832529d687f5f7a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_049ba77de43b4702832529d687f5f7a3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/049ba77de43b4702832529d687f5f7a3"}]}] Jul 28 05:46:46.445053 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant: tempest-TestVolumeBootPattern-1858841219 Jul 28 05:46:46.445053 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Id: 049ba77de43b4702832529d687f5f7a3 Jul 28 05:46:46.445053 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Name: tempest-TestVolumeBootPattern-1858841219 Jul 28 05:46:46.445053 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User: tempest-TestVolumeBootPattern-1858841219-project Jul 28 05:46:46.445053 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Id: default Jul 28 05:46:46.445053 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Name: Default Jul 28 05:46:46.445053 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Id: 09217832f8e74db38d990d25faee4305 Jul 28 05:46:46.445053 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Name: tempest-TestVolumeBootPattern-1858841219-project Jul 28 05:46:46.445053 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: method: > Jul 28 05:46:46.445053 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: exception: Instance e943ad39-1dca-4798-9e61-12305b570d2b could not be found. Jul 28 05:46:46.445053 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: action_args: {'id': 'e943ad39-1dca-4798-9e61-12305b570d2b'} Jul 28 05:46:46.446249 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 05:46:46.446249 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:46:46.446249 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 05:46:46.446249 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 05:46:46.446249 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 05:46:46.446249 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 05:46:46.446249 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 05:46:46.446249 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 05:46:46.446249 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 05:46:46.446249 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 05:46:46.446249 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e943ad39-1dca-4798-9e61-12305b570d2b could not be found. Jul 28 05:46:46.446249 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:46:46.446249 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:46:46.446249 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:46:46.446249 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:46:46.446249 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:46:46.446249 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:46:46.446249 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 05:46:46.446249 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 05:46:46.446249 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 05:46:46.447914 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:46:46.447914 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 05:46:46.447914 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 05:46:46.447914 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 05:46:46.447914 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 05:46:46.447914 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 05:46:46.447914 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 05:46:46.447914 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e943ad39-1dca-4798-9e61-12305b570d2b could not be found. Jul 28 05:46:46.447914 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:46:46.447914 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:46:46.447914 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:46:46.447914 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:46:46.447914 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:46:46.447914 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:46:46.447914 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 05:46:46.447914 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 05:46:46.447914 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e943ad39-1dca-4798-9e61-12305b570d2b could not be found. Jul 28 05:46:46.447914 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:46:46.449459 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-054441e6-cc7c-41f6-96b6-dffa333485a9 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Returning 404 to user: Instance e943ad39-1dca-4798-9e61-12305b570d2b could not be found. {{(pid=124482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 05:46:46.449459 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-054441e6-cc7c-41f6-96b6-dffa333485a9 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "GET /compute/v2.1/servers/e943ad39-1dca-4798-9e61-12305b570d2b" status: 404 len: 111 microversion: 2.1 time: 0.029341 Jul 28 05:46:46.449459 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 875/1099] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:46:46 2022] GET /compute/v2.1/servers/e943ad39-1dca-4798-9e61-12305b570d2b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 05:46:49.740541 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-9b6f3b1a-fc11-47d8-90f2-4b22c0484212 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:46:49.741258 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-9b6f3b1a-fc11-47d8-90f2-4b22c0484212 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: 1fe47f0f-c147-41c9-aea0-f96143e91d6c] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:46:49.748059 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9b6f3b1a-fc11-47d8-90f2-4b22c0484212 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:46:49.750884 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9b6f3b1a-fc11-47d8-90f2-4b22c0484212 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:46:49.750884 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9b6f3b1a-fc11-47d8-90f2-4b22c0484212 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:46:49.750884 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-9b6f3b1a-fc11-47d8-90f2-4b22c0484212 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:46:49.777845 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-9b6f3b1a-fc11-47d8-90f2-4b22c0484212 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: 1fe47f0f-c147-41c9-aea0-f96143e91d6c] Going to try to terminate instance {{(pid=124482) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 05:46:49.983714 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-9b6f3b1a-fc11-47d8-90f2-4b22c0484212 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1fe47f0f-c147-41c9-aea0-f96143e91d6c" status: 204 len: 0 microversion: 2.1 time: 0.246879 Jul 28 05:46:49.984851 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 876/1100] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Jul 28 05:46:49 2022] DELETE /compute/v2.1/servers/1fe47f0f-c147-41c9-aea0-f96143e91d6c => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 05:46:49.989910 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-bf990c06-0553-49c1-b80d-a0052ca4155a req-70cc9c76-2d06-454d-be6e-3a81ac5fb625 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fe47f0f-c147-41c9-aea0-f96143e91d6c", "tag": "84c91d50-101f-41c8-a4a8-e7ece7ef0ce0"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:46:49.999018 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-bf990c06-0553-49c1-b80d-a0052ca4155a req-70cc9c76-2d06-454d-be6e-3a81ac5fb625 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:46:49.999455 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-bf990c06-0553-49c1-b80d-a0052ca4155a req-70cc9c76-2d06-454d-be6e-3a81ac5fb625 service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:46:50.013626 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-bf990c06-0553-49c1-b80d-a0052ca4155a req-70cc9c76-2d06-454d-be6e-3a81ac5fb625 service nova] Creating event network-changed:84c91d50-101f-41c8-a4a8-e7ece7ef0ce0 for instance 1fe47f0f-c147-41c9-aea0-f96143e91d6c on hv-cinder-79987 Jul 28 05:46:50.015667 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-bf990c06-0553-49c1-b80d-a0052ca4155a req-70cc9c76-2d06-454d-be6e-3a81ac5fb625 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029511 Jul 28 05:46:50.016417 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 877/1101] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:46:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:46:50.021348 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-ec358996-49a5-40c1-98db-2f379120cb9b tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:46:50.022067 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-ec358996-49a5-40c1-98db-2f379120cb9b tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: 1fe47f0f-c147-41c9-aea0-f96143e91d6c] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:46:50.028191 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ec358996-49a5-40c1-98db-2f379120cb9b tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:46:50.028574 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ec358996-49a5-40c1-98db-2f379120cb9b tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:46:50.029319 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ec358996-49a5-40c1-98db-2f379120cb9b tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:46:50.029782 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-ec358996-49a5-40c1-98db-2f379120cb9b tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:46:50.163908 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-ec358996-49a5-40c1-98db-2f379120cb9b tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09217832f8e74db38d990d25faee4305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049ba77de43b4702832529d687f5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:46:50.171711 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-ec358996-49a5-40c1-98db-2f379120cb9b tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "GET /compute/v2.1/servers/1fe47f0f-c147-41c9-aea0-f96143e91d6c" status: 200 len: 1575 microversion: 2.1 time: 0.154117 Jul 28 05:46:50.179372 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 878/1102] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:46:50 2022] GET /compute/v2.1/servers/1fe47f0f-c147-41c9-aea0-f96143e91d6c => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:46:51.193229 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-c796dac3-0c26-41eb-8340-7f5e3a9af15a tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:46:51.193959 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-c796dac3-0c26-41eb-8340-7f5e3a9af15a tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: 1fe47f0f-c147-41c9-aea0-f96143e91d6c] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:46:51.200344 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c796dac3-0c26-41eb-8340-7f5e3a9af15a tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:46:51.204287 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c796dac3-0c26-41eb-8340-7f5e3a9af15a tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:46:51.204287 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c796dac3-0c26-41eb-8340-7f5e3a9af15a tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:46:51.204287 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-c796dac3-0c26-41eb-8340-7f5e3a9af15a tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:46:51.336309 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-c796dac3-0c26-41eb-8340-7f5e3a9af15a tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09217832f8e74db38d990d25faee4305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049ba77de43b4702832529d687f5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:46:51.344148 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-c796dac3-0c26-41eb-8340-7f5e3a9af15a tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "GET /compute/v2.1/servers/1fe47f0f-c147-41c9-aea0-f96143e91d6c" status: 200 len: 1575 microversion: 2.1 time: 0.154806 Jul 28 05:46:51.344724 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 879/1103] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:46:51 2022] GET /compute/v2.1/servers/1fe47f0f-c147-41c9-aea0-f96143e91d6c => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:46:52.108515 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [req-3ce93c90-b670-4bb2-ac15-1a353d7ffd4b req-0b5fd139-cc5f-4aea-9adf-78811d126a6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fe47f0f-c147-41c9-aea0-f96143e91d6c", "name": "network-vif-deleted", "tag": "84c91d50-101f-41c8-a4a8-e7ece7ef0ce0"}]} {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:46:52.117684 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-3ce93c90-b670-4bb2-ac15-1a353d7ffd4b req-0b5fd139-cc5f-4aea-9adf-78811d126a6c service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:46:52.120327 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [req-3ce93c90-b670-4bb2-ac15-1a353d7ffd4b req-0b5fd139-cc5f-4aea-9adf-78811d126a6c service nova] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:46:52.131433 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.compute.server_external_events [req-3ce93c90-b670-4bb2-ac15-1a353d7ffd4b req-0b5fd139-cc5f-4aea-9adf-78811d126a6c service nova] Creating event network-vif-deleted:84c91d50-101f-41c8-a4a8-e7ece7ef0ce0 for instance 1fe47f0f-c147-41c9-aea0-f96143e91d6c on hv-cinder-79987 Jul 28 05:46:52.136368 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [req-3ce93c90-b670-4bb2-ac15-1a353d7ffd4b req-0b5fd139-cc5f-4aea-9adf-78811d126a6c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031660 Jul 28 05:46:52.137391 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 880/1104] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jul 28 05:46:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 05:46:52.366741 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-fe0a1707-76dd-4827-9bf9-f11ee6f8d4fc tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:46:52.367621 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-fe0a1707-76dd-4827-9bf9-f11ee6f8d4fc tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: 1fe47f0f-c147-41c9-aea0-f96143e91d6c] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:46:52.373746 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-fe0a1707-76dd-4827-9bf9-f11ee6f8d4fc tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:46:52.374194 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-fe0a1707-76dd-4827-9bf9-f11ee6f8d4fc tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:46:52.374961 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-fe0a1707-76dd-4827-9bf9-f11ee6f8d4fc tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:46:52.375401 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-fe0a1707-76dd-4827-9bf9-f11ee6f8d4fc tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:46:52.441978 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.policy [None req-fe0a1707-76dd-4827-9bf9-f11ee6f8d4fc tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09217832f8e74db38d990d25faee4305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049ba77de43b4702832529d687f5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124482) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:46:52.450496 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-fe0a1707-76dd-4827-9bf9-f11ee6f8d4fc tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "GET /compute/v2.1/servers/1fe47f0f-c147-41c9-aea0-f96143e91d6c" status: 200 len: 1224 microversion: 2.1 time: 0.088404 Jul 28 05:46:52.451074 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 881/1105] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:46:52 2022] GET /compute/v2.1/servers/1fe47f0f-c147-41c9-aea0-f96143e91d6c => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:46:53.472145 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-65d59b24-50a0-4c01-9a6f-18ec0fc44499 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:46:53.472828 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-65d59b24-50a0-4c01-9a6f-18ec0fc44499 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: 1fe47f0f-c147-41c9-aea0-f96143e91d6c] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:46:53.479246 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-65d59b24-50a0-4c01-9a6f-18ec0fc44499 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:46:53.479686 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-65d59b24-50a0-4c01-9a6f-18ec0fc44499 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:46:53.480442 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-65d59b24-50a0-4c01-9a6f-18ec0fc44499 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:46:53.480875 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-65d59b24-50a0-4c01-9a6f-18ec0fc44499 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:46:53.498343 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.wsgi [None req-65d59b24-50a0-4c01-9a6f-18ec0fc44499 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] HTTP exception thrown: Instance 1fe47f0f-c147-41c9-aea0-f96143e91d6c could not be found. Jul 28 05:46:53.499963 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-65d59b24-50a0-4c01-9a6f-18ec0fc44499 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Request method failure captured: Jul 28 05:46:53.499963 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: request: GET /compute/v2.1/servers/1fe47f0f-c147-41c9-aea0-f96143e91d6c HTTP/1.1 Jul 28 05:46:53.499963 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept: application/json Jul 28 05:46:53.499963 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept-Encoding: identity Jul 28 05:46:53.499963 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Connection: close Jul 28 05:46:53.499963 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Length: 0 Jul 28 05:46:53.499963 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Type: application/json Jul 28 05:46:53.499963 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Host: 10.222.0.33 Jul 28 05:46:53.499963 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Openstack-System-Scope: None Jul 28 05:46:53.499963 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: User-Agent: python-urllib3/1.26.10 Jul 28 05:46:53.499963 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Auth-Token: gAAAAABi4iEUo10EjyAiud_HlyChWASyUX53ZLs3bgD62XMeHj1VqA0lRf7jrNh3T0aAZ5wTRe5tWSLfiJxJdbXzkIEiKWbrjbQ8IpmbYJbAEVE0ubJjmJBSpi2IwOVOQrh4CbPbW6q1MQrZtCWhkLk1sbnuwe5TQw4-WijLZSbY2qEMOhK2mWs Jul 28 05:46:53.499963 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Id: None Jul 28 05:46:53.499963 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Name: None Jul 28 05:46:53.499963 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Identity-Status: Confirmed Jul 28 05:46:53.499963 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Is-Admin-Project: True Jul 28 05:46:53.499963 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Id: default Jul 28 05:46:53.499963 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Name: Default Jul 28 05:46:53.499963 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Id: 049ba77de43b4702832529d687f5f7a3 Jul 28 05:46:53.499963 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Name: tempest-TestVolumeBootPattern-1858841219 Jul 28 05:46:53.499963 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Role: member,reader Jul 28 05:46:53.499963 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Roles: member,reader Jul 28 05:46:53.502283 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/049ba77de43b4702832529d687f5f7a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/049ba77de43b4702832529d687f5f7a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_049ba77de43b4702832529d687f5f7a3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/049ba77de43b4702832529d687f5f7a3"}]}] Jul 28 05:46:53.502283 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant: tempest-TestVolumeBootPattern-1858841219 Jul 28 05:46:53.502283 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Id: 049ba77de43b4702832529d687f5f7a3 Jul 28 05:46:53.502283 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Name: tempest-TestVolumeBootPattern-1858841219 Jul 28 05:46:53.502283 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User: tempest-TestVolumeBootPattern-1858841219-project Jul 28 05:46:53.502283 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Id: default Jul 28 05:46:53.502283 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Name: Default Jul 28 05:46:53.502283 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Id: 09217832f8e74db38d990d25faee4305 Jul 28 05:46:53.502283 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Name: tempest-TestVolumeBootPattern-1858841219-project Jul 28 05:46:53.502283 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: method: > Jul 28 05:46:53.502283 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: exception: Instance 1fe47f0f-c147-41c9-aea0-f96143e91d6c could not be found. Jul 28 05:46:53.502283 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: action_args: {'id': '1fe47f0f-c147-41c9-aea0-f96143e91d6c'} Jul 28 05:46:53.503345 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 05:46:53.503345 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:46:53.503345 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 05:46:53.503345 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 05:46:53.503345 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 05:46:53.503345 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 05:46:53.503345 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 05:46:53.503345 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 05:46:53.503345 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 05:46:53.503345 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 05:46:53.503345 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fe47f0f-c147-41c9-aea0-f96143e91d6c could not be found. Jul 28 05:46:53.503345 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:46:53.503345 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:46:53.503345 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:46:53.503345 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:46:53.503345 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:46:53.503345 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:46:53.503345 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 05:46:53.503345 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 05:46:53.503345 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 05:46:53.504835 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:46:53.504835 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 05:46:53.504835 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 05:46:53.504835 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 05:46:53.504835 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 05:46:53.504835 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 05:46:53.504835 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 05:46:53.504835 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fe47f0f-c147-41c9-aea0-f96143e91d6c could not be found. Jul 28 05:46:53.504835 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:46:53.504835 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:46:53.504835 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:46:53.504835 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:46:53.504835 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:46:53.504835 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:46:53.504835 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 05:46:53.504835 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 05:46:53.504835 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fe47f0f-c147-41c9-aea0-f96143e91d6c could not be found. Jul 28 05:46:53.504835 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:46:53.506233 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-65d59b24-50a0-4c01-9a6f-18ec0fc44499 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Returning 404 to user: Instance 1fe47f0f-c147-41c9-aea0-f96143e91d6c could not be found. {{(pid=124482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 05:46:53.506233 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-65d59b24-50a0-4c01-9a6f-18ec0fc44499 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "GET /compute/v2.1/servers/1fe47f0f-c147-41c9-aea0-f96143e91d6c" status: 404 len: 111 microversion: 2.1 time: 0.033798 Jul 28 05:46:53.506233 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 882/1106] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:46:53 2022] GET /compute/v2.1/servers/1fe47f0f-c147-41c9-aea0-f96143e91d6c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 05:46:53.998775 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-f124e81f-bc03-4996-abfc-488f886e2b89 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:46:53.999311 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-f124e81f-bc03-4996-abfc-488f886e2b89 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: 72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:46:54.005698 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f124e81f-bc03-4996-abfc-488f886e2b89 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:46:54.006154 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f124e81f-bc03-4996-abfc-488f886e2b89 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:46:54.006918 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f124e81f-bc03-4996-abfc-488f886e2b89 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:46:54.007356 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-f124e81f-bc03-4996-abfc-488f886e2b89 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:46:54.021389 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.wsgi [None req-f124e81f-bc03-4996-abfc-488f886e2b89 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] HTTP exception thrown: Instance 72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18 could not be found. Jul 28 05:46:54.022987 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-f124e81f-bc03-4996-abfc-488f886e2b89 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Request method failure captured: Jul 28 05:46:54.022987 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: request: DELETE /compute/v2.1/servers/72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18 HTTP/1.1 Jul 28 05:46:54.022987 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept: application/json Jul 28 05:46:54.022987 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept-Encoding: identity Jul 28 05:46:54.022987 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Connection: close Jul 28 05:46:54.022987 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Length: 0 Jul 28 05:46:54.022987 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Type: application/json Jul 28 05:46:54.022987 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Host: 10.222.0.33 Jul 28 05:46:54.022987 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Openstack-System-Scope: None Jul 28 05:46:54.022987 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: User-Agent: python-urllib3/1.26.10 Jul 28 05:46:54.022987 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Auth-Token: gAAAAABi4iEUo10EjyAiud_HlyChWASyUX53ZLs3bgD62XMeHj1VqA0lRf7jrNh3T0aAZ5wTRe5tWSLfiJxJdbXzkIEiKWbrjbQ8IpmbYJbAEVE0ubJjmJBSpi2IwOVOQrh4CbPbW6q1MQrZtCWhkLk1sbnuwe5TQw4-WijLZSbY2qEMOhK2mWs Jul 28 05:46:54.022987 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Id: None Jul 28 05:46:54.022987 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Name: None Jul 28 05:46:54.022987 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Identity-Status: Confirmed Jul 28 05:46:54.022987 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Is-Admin-Project: True Jul 28 05:46:54.022987 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Id: default Jul 28 05:46:54.022987 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Name: Default Jul 28 05:46:54.022987 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Id: 049ba77de43b4702832529d687f5f7a3 Jul 28 05:46:54.022987 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Name: tempest-TestVolumeBootPattern-1858841219 Jul 28 05:46:54.022987 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Role: member,reader Jul 28 05:46:54.022987 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Roles: member,reader Jul 28 05:46:54.024820 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/049ba77de43b4702832529d687f5f7a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/049ba77de43b4702832529d687f5f7a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_049ba77de43b4702832529d687f5f7a3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/049ba77de43b4702832529d687f5f7a3"}]}] Jul 28 05:46:54.024820 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant: tempest-TestVolumeBootPattern-1858841219 Jul 28 05:46:54.024820 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Id: 049ba77de43b4702832529d687f5f7a3 Jul 28 05:46:54.024820 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Name: tempest-TestVolumeBootPattern-1858841219 Jul 28 05:46:54.024820 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User: tempest-TestVolumeBootPattern-1858841219-project Jul 28 05:46:54.024820 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Id: default Jul 28 05:46:54.024820 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Name: Default Jul 28 05:46:54.024820 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Id: 09217832f8e74db38d990d25faee4305 Jul 28 05:46:54.024820 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Name: tempest-TestVolumeBootPattern-1858841219-project Jul 28 05:46:54.024820 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: method: > Jul 28 05:46:54.024820 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: exception: Instance 72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18 could not be found. Jul 28 05:46:54.024820 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: action_args: {'id': '72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18'} Jul 28 05:46:54.025908 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 05:46:54.025908 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:46:54.025908 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 05:46:54.025908 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 05:46:54.025908 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 05:46:54.025908 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 05:46:54.025908 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 05:46:54.025908 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 05:46:54.025908 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 05:46:54.025908 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 05:46:54.025908 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18 could not be found. Jul 28 05:46:54.025908 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:46:54.025908 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:46:54.025908 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:46:54.025908 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:46:54.025908 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:46:54.025908 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:46:54.025908 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 05:46:54.025908 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 05:46:54.025908 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 05:46:54.027458 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:46:54.027458 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 05:46:54.027458 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 05:46:54.027458 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 05:46:54.027458 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 05:46:54.027458 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 05:46:54.027458 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 05:46:54.027458 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 05:46:54.027458 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 05:46:54.027458 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18 could not be found. Jul 28 05:46:54.027458 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:46:54.027458 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:46:54.027458 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:46:54.027458 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:46:54.027458 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:46:54.027458 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:46:54.027458 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 05:46:54.027458 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 05:46:54.027458 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18 could not be found. Jul 28 05:46:54.027458 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:46:54.029269 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-f124e81f-bc03-4996-abfc-488f886e2b89 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Returning 404 to user: Instance 72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18 could not be found. {{(pid=124482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 05:46:54.029269 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-f124e81f-bc03-4996-abfc-488f886e2b89 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "DELETE /compute/v2.1/servers/72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18" status: 404 len: 111 microversion: 2.1 time: 0.029596 Jul 28 05:46:54.029269 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 883/1107] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Jul 28 05:46:53 2022] DELETE /compute/v2.1/servers/72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 05:46:54.033348 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-022f9791-a98c-4110-af2a-f73b287b6b15 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:46:54.034033 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.compute.api [None req-022f9791-a98c-4110-af2a-f73b287b6b15 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] [instance: 72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18] Fetching instance by UUID {{(pid=124482) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 05:46:54.039827 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-022f9791-a98c-4110-af2a-f73b287b6b15 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:46:54.040277 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-022f9791-a98c-4110-af2a-f73b287b6b15 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:46:54.041067 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-022f9791-a98c-4110-af2a-f73b287b6b15 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:46:54.041541 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG oslo_concurrency.lockutils [None req-022f9791-a98c-4110-af2a-f73b287b6b15 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Lock "2db56fa7-dc06-44d8-9adb-2fc5d306a2ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:46:54.054744 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.wsgi [None req-022f9791-a98c-4110-af2a-f73b287b6b15 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] HTTP exception thrown: Instance 72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18 could not be found. Jul 28 05:46:54.056252 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-022f9791-a98c-4110-af2a-f73b287b6b15 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Request method failure captured: Jul 28 05:46:54.056252 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: request: GET /compute/v2.1/servers/72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18 HTTP/1.1 Jul 28 05:46:54.056252 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept: application/json Jul 28 05:46:54.056252 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Accept-Encoding: identity Jul 28 05:46:54.056252 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Connection: close Jul 28 05:46:54.056252 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Length: 0 Jul 28 05:46:54.056252 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Content-Type: application/json Jul 28 05:46:54.056252 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Host: 10.222.0.33 Jul 28 05:46:54.056252 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Openstack-System-Scope: None Jul 28 05:46:54.056252 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: User-Agent: python-urllib3/1.26.10 Jul 28 05:46:54.056252 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Auth-Token: gAAAAABi4iEUo10EjyAiud_HlyChWASyUX53ZLs3bgD62XMeHj1VqA0lRf7jrNh3T0aAZ5wTRe5tWSLfiJxJdbXzkIEiKWbrjbQ8IpmbYJbAEVE0ubJjmJBSpi2IwOVOQrh4CbPbW6q1MQrZtCWhkLk1sbnuwe5TQw4-WijLZSbY2qEMOhK2mWs Jul 28 05:46:54.056252 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Id: None Jul 28 05:46:54.056252 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Domain-Name: None Jul 28 05:46:54.056252 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Identity-Status: Confirmed Jul 28 05:46:54.056252 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Is-Admin-Project: True Jul 28 05:46:54.056252 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Id: default Jul 28 05:46:54.056252 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Domain-Name: Default Jul 28 05:46:54.056252 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Id: 049ba77de43b4702832529d687f5f7a3 Jul 28 05:46:54.056252 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Project-Name: tempest-TestVolumeBootPattern-1858841219 Jul 28 05:46:54.056252 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Role: member,reader Jul 28 05:46:54.056252 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Roles: member,reader Jul 28 05:46:54.058020 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/049ba77de43b4702832529d687f5f7a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/049ba77de43b4702832529d687f5f7a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_049ba77de43b4702832529d687f5f7a3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/049ba77de43b4702832529d687f5f7a3"}]}] Jul 28 05:46:54.058020 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant: tempest-TestVolumeBootPattern-1858841219 Jul 28 05:46:54.058020 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Id: 049ba77de43b4702832529d687f5f7a3 Jul 28 05:46:54.058020 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-Tenant-Name: tempest-TestVolumeBootPattern-1858841219 Jul 28 05:46:54.058020 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User: tempest-TestVolumeBootPattern-1858841219-project Jul 28 05:46:54.058020 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Id: default Jul 28 05:46:54.058020 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Domain-Name: Default Jul 28 05:46:54.058020 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Id: 09217832f8e74db38d990d25faee4305 Jul 28 05:46:54.058020 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: X-User-Name: tempest-TestVolumeBootPattern-1858841219-project Jul 28 05:46:54.058020 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: method: > Jul 28 05:46:54.058020 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: exception: Instance 72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18 could not be found. Jul 28 05:46:54.058020 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: action_args: {'id': '72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18'} Jul 28 05:46:54.058920 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 05:46:54.058920 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:46:54.058920 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 05:46:54.058920 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 05:46:54.058920 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 05:46:54.058920 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 05:46:54.058920 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 05:46:54.058920 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 05:46:54.058920 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 05:46:54.058920 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 05:46:54.058920 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18 could not be found. Jul 28 05:46:54.058920 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:46:54.058920 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:46:54.058920 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:46:54.058920 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:46:54.058920 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:46:54.058920 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:46:54.058920 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 05:46:54.058920 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 05:46:54.058920 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 05:46:54.060518 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:46:54.060518 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 05:46:54.060518 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 05:46:54.060518 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 05:46:54.060518 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 05:46:54.060518 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 05:46:54.060518 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 05:46:54.060518 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18 could not be found. Jul 28 05:46:54.060518 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:46:54.060518 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:46:54.060518 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:46:54.060518 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:46:54.060518 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:46:54.060518 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:46:54.060518 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 05:46:54.060518 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 05:46:54.060518 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18 could not be found. Jul 28 05:46:54.060518 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: ERROR nova.api.openstack.wsgi Jul 28 05:46:54.061989 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-022f9791-a98c-4110-af2a-f73b287b6b15 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Returning 404 to user: Instance 72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18 could not be found. {{(pid=124482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 05:46:54.061989 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-022f9791-a98c-4110-af2a-f73b287b6b15 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "GET /compute/v2.1/servers/72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18" status: 404 len: 111 microversion: 2.1 time: 0.028642 Jul 28 05:46:54.061989 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 884/1108] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Jul 28 05:46:54 2022] GET /compute/v2.1/servers/72d21a4d-a3ad-44c9-8a4b-dc01d5c75f18 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 05:46:55.523964 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: DEBUG nova.api.openstack.wsgi [None req-51c1fa3b-3f3f-495c-87c8-d41037588ac4 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] Calling method '.version_select at 0x7f25e03f7430>' {{(pid=124482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:46:55.590620 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO nova.api.openstack.requestlog [None req-51c1fa3b-3f3f-495c-87c8-d41037588ac4 tempest-TestVolumeBootPattern-1858841219 tempest-TestVolumeBootPattern-1858841219-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-394088638" status: 202 len: 0 microversion: 2.1 time: 0.080319 Jul 28 05:46:55.591205 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: [pid: 124482|app: 0|req: 885/1109] 10.222.0.33 () {58 vars in 1260 bytes} [Thu Jul 28 05:46:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-394088638 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 05:49:59.710062 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 05:49:59.710739 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Thu Jul 28 05:49:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 05:50:05.944569 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 05:50:05.945156 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Thu Jul 28 05:50:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 05:52:03.124397 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 05:52:03.125123 dv-cinder-799871-48-iscsi devstack@n-api.service[124482]: Thu Jul 28 05:52:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!